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(54) SALES PREDICTION DEVICE CONSIDERING POPULARITY PREDICTION OF PRODUCT AND PREDICTION 
METHOD THEREFOR 

(57)Abstract: 

PROBLEM TO BE SOLVED: To quickly reflect the popularity of 
products on a production sales schedule by recognizing the tendency 
of the type, constitution and sales transition of persons who purchase 
the product in the initial stage of the sale of the product and 
predicting the sales of the product. 

SOLUTION: A sales data input means 9 sends the sales data of the 
product to this sales prediction device 1 preferably in real time. Then, 
by a sales transition stage estimation means 10, the sales transition 
stage of the product is estimated. Then, a customer type specifying 
means 1 1 inputs customer data inputted by the sales data input 
means 9, retrieves a customer type data base 1 6 for respective 
customers and specifies the customer type from the pertinent 
customer data. A sales prediction means 12 inputs the sales 
transition stage estimated by the sales transition stage estimation 
means 10, the customer type specified by the customer type 
specifying means 1 1 and a sales prediction model calculated by a 
sales prediction model calculation means 8 and predicts the sales of a 
prediction object product or the degree of the popularity by using the 
data and a numerical formula, etc. 
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II. 2. 9 Score Point Calculation 

After attribute items of characteristics are classified, a 
score table is to be prepared in a next step. The table shows 
scores of respective attributes assigned to the pertinent 
applicant. An example of the score table is shown in Table 1. 
A total of scores set to appropriate attributes is "credit score" 
which usually called "score". 
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^ > tf i - < I; ^ h -> X 7=- A ^ c T . 

)U \z^^pjmu n >;n*— ^ t , 

h ;L'Ttf IE prtg;^£y O 7 ^ i?'-/^' t , 

fcfTifi t ^ Id re jlt" -5 < t =b 1 o ® X > 5=- -("^ 

"f-jKB^misi-rirzif), m^^-iS'^-7.\zmimmmL 

h;i/$r^fiJc-r^->X5^ATS)oT, 

tf :i — rJ' < b ^ n -> X -r- A T? o T . 

A^^f X>5^^'5^^'/^i7 V)V^'^lL'^^ti.x.y7-^7- 




!ttH 2000-20555 

^' 7^7'5'<hS:-&?^>'XT-A. 

^'>U< ii%\'D(D:Ly7-^7-^'^^ Y)\'^mmt^Yc 

-7.\zws\-^nrzy.y'T ^ ^ V)\^-n7^^7.t^ 

T'. li^^n^c:fT»l*1fffi7'r5^AtM]^t?tt«.:&?tT 
T-f 5^A*^-riS^©x>'?^'T--i"<i7 h;Vi:JtfebT 

mmm.^^nfz.nwit.mzmmt^'}>'t£< tt>iocDx 

«^ j£^<D X- ^ X * Ji#^r S X 5" <y :/ 1 , 

m^nrznwj^nW}^^ h;Kc^m-r^x?-v-/t, 
mmmiEvrzfny^~)V'^i7h}u^. m'fjiiB^^-r 

^«^CDX>T-^'5=-^'^i7 hJl/tltebTMfBm!^:^ nfc 

X fC 7 -feXT -5 X 7^ <;/ . 
[«*3S9] 7'-iS'tBti:S«^^tJ:3>bfi-i$'± 

:i—if(Dmm-^ntz'<m^nw3^^ h;utca^-rsxx 

^_;l,^/7 h;i'*^IE-r^XT->;/:/<i:, 

C^^:>T, ■|*?B7-l'7=-A^7R-r X>T-f K^l'SIf 
iE-r ^ X5^ ^^?^:&feo 




m^/A^ wt'- ^ ^— X * titt-r -5 X 5=- :/ 1 . 

n > tfi-iS' fc*5tt-&:i— If 3 > tfi-^'^SWli^^ 
7 -t 7. t" ^ X 5^ <y y t . 

So 

[0 0 0 1] 

:$i%miimm^nfcnm\zm-:3^^xm^. ^-it-y. m. 

-> X 5^ A 43 J: P -fe X {cur . 
[0 0 0 2] 




2000-20555 
<h b it ^- X Til W W ICje^ $r :i— if JC [S] ^ d t O bI 

icjfi5^$nfc'^7xr/^->'(c-^$tis r^tBL/A^j^ 

* b: X (CO TO $ e, ;i If ffi/Ot Ji« ^ n 

^/A^io'^'xi/it-i' hfcjifsn^o ^fi®-f>'^'-^- 

*Sitt®«»®Ste:;^teTa&-5» ^mibT, ^^offi 

^(DjA^W^SSffilCfiSHar^. bfc/S^oT. 
i^U <;/i'x;i/-®«:;k:jk:)i^, ■^n.m-^-om^moyW}s<D 
aSlciO. ;*:gB^J-co>:>x:/-ti--r htctr3TftfefiST 

[0 0 0 3] \^<-z>t-^(DWs.<r>'^^\^^^m^wi^-^. 

tiTw^tcUX hf ^, cn?.©SW«20CDi75'XtC 

»!®$ti^, «i tc^t-;A^jM#^tt^B®^-©i7 5x 
tt. 7F^ot;im©itis©*-ica^<:^M'fbbfc^-w-^ 
®s^i5<&fflv^^. *2ic^-rj£*s*?fi^tri®^=®i'^ 

0, a&^i/i«*mrtcBj^^nfc:i— y-*©*[Sl*?iJffl-r 
-5. J:DSi5*c:e.b;fc|g=1tt{^<D/£^jMK->x5"A(c 

*3ViTfie^^n^S^BcDVi<-S)*^$r^JfflL-TVi-?>. UA^ 

P>g^*tt$ttcT^fcltT35^, «l:teJ:t>*«2tC 
*3ViT. &;&fefc!tt5£;^c:=Flc-&.^*til^$nTi^^*i, 

[0 0 0 4] 

[« 1 ] 
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. 3.-- t^'iOtf WidSffi^ ^^^9^J^^ ^ :r\zMm'r^ r i: ^ 










I C3— K 








- I FT Kv:*ic^ti-6S I Ca^ K^ftjfiffOjEiia-^- 







[0 0 0 5] [« 2 ] S-1H:f^Ji:^*f^#(tSffi 
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• 2^l*w?5f»lf^^c«t^s^^Bifcov^T^o^;^<(o^^»f^^^:.K 



























[0 0 0 6] a«E®'i7x:rs«T«, ^L-mtmmt^ 

[0 0 0 7] « 1 43 iw^s 2 \zm-r^^mmm\i. m^^ 
=rutcM]S-r^. z.nib(Dti7-zi^)\z\t.^ uiTA^-a^ti 

-5. 

( i ) m\\z^-^<mm 

(i i) ^-'7-K(c»-:?<;2:SjiS? 

(i i i) m'^(D^x.zr<-~J^rz.\t-^^ h'^O^Jt^m 
(i v) ^-v®^SSli^fC*5tt^-/5>5''v<^iAa-fiJ 
(v) ^^|5l7>r';i/iS'U>y 

^ti'rz!^) (Dm,m^^A'v\zm^^o 

[0 0 0 8] (ffiliJlcSoX/S^iMS?) ffiIiJ{cScf</2: 

KiTn- Y\t^n. mm^^timmoi^mzm^'^mm 



[0 0 0 9] ;i;^3is?«fc«6®?*iiJ«. ^^su 

[0 0 10] mm\zm-:s<jii^mmz\t.. nmin<bn 

ifcfbfPM^ fc-^ T © jSlg H tc t> ^ aii75«i£:^ST* 

$e.{c, AFa^H. mm^:3--V^t-r^z.ii\z^ 

«, #S5:«^^*J. =^y'Mt-^n^f^m<nm.m\z'^^n 

[0 0 11] (+-9-F(c»'cf<;2:^3i*?) 
H tcS-:^ < jA^ii^® -> 7. 7^ A T /S-g^:!— tf 7!)t^ 

^^©+-•7- F4-^tJ«-&, #IfiT^-7- KJcMii 
S^^^nfe^^-y-Ktc^ifbTrofB^^ttct^^o b 

mm-^^^jt^izmm-r^^-u- ]^^^W}'^-m^i^ti» 
}K^^^<^mi$,(Dm^^^m\zm-:i^. 
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[0 0 12] (1H>Sr»^-v?'v®j2:^iiJ0ST) /S^ti 

[0013] e^-v^opgBSrwr^-/^ >^'\®;2:b- 
AFb^ Wl? ^'3 55^ i£JSTa& ^ , 

[0 0 14] ('j7x:/-y-'r h-^(D!KBmK)^x) }K^\t 

[0 0 15] (^|si7-i';i'iS"J ^i^iStfi) 
U>i^ (CF) mWM. jM*?W{C!|#«CDJES^':7x:/rL 
— tf(c*t^#tt*tVip^So>ts6fcil^$n;t. CF 

^ cD=L-;'^-X-^mmhmz^m-r^^K)\,ttib:5±< 

^itLf£\,^m^^zmh^<mm-r^. -f>^-^>yhtiT 

— ^-C«^cVi= $?>{c, CF7yp-?^©*ffl'[itt. S 

s^fijsif ^fTo rz=L—^a:)mzm.mmm-r^o mx<D^m 
z.nib(Dpm^n^o)\z-si-mfi^^M(Dmti^m'p-rz. 



[0 0 16] CF^g^fe«aS> Pp1®SFBl(7)i>:7ic;*^#lt 

ie:^si?s>-5o b75^u;^tJ&ie., ;i<7)«pffin, n-se^Kcsaa 

[0 0 17] it?^c7)/£&iij;->:;^^A«, ^{'i^-#> 
* J; § I CD*fMW14K I' a* [fi] T V i I 

[0 0 18] 

^grt^tCOV^T. 3.—- t)-*fTill^jiS»-r^->XT-A<£:ie^S 

<i An--- tf-tn^'n'NaaA^ < *f^#ttfcBg^;£^*^ Bits 

[0 0 19] 

m<Dmmizm-:^\^^x, a.— tftc^s^, {7-:^>. ms>^ 

[0 0 2 0] 2|s:^H^«x>5^^-7^^^fc«a>5^>h'^ 
UTJVtl.^i' h)V<DmmX'$>^, ->X-T-Att> AliWtC 
WT;i-:3'UX*A^fiJfflT-5. ;ico^^7;ud'UXAti, 
©3>7^>h^i7 h;U*«iJOST^o SSSiLTfi?, 

[0 0 2 1] Ox.-:/^-z^. JLttSbiA^. i7-zt^>43=k 
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[0 0 2 2] ^=L—if(DW}mt. -fay^-jv^i^hJl 
T«t3^n^. AMW?^tn.— tf®»)f^tc«. ^—y(DW 

[0 0 2 3] :x— ifyn^w-— hJl/ti, rL— +ftc 

[0 0 2 4] ^fz. *5!0^«, X>5^^-5^^"^i7 h;i.cD 
$g$-^*bfcJl-&, ^•cc)i2:'&«x>7^-<5^-i-^i' 

-5. 

[0 0 2 5] :$:v-XT-A(C*3liT, O.— tf^D:?^ — ;i/ 
[0 0 2 6] mmz. /2:^*3j;tX^-7l^>X>5^-i'5=-'C 

^3\^m^rz:3.—vf(nm^(Dm^j'^:3-\i^t-r^o 

^(D^Wi(Dmm\t. ffi!p°pBBS€'lfIEL. ^(^ffi!D°p^fe« 

[0 0 2 7] ->;^7^A«. ^±\z^m<f^n. wimz^ 
fT»i*fijffl UTUif^L, iEmymi'^<Drztb(D=L-^(DBn 



[0 0 2 8] 

[0 0 2 9] mut, *^B^jcgcjaT-5=i>tfj.-^s 
1 0 0 tt. ^-1? 1 0 2 iij:v^mmmm i o s ^Sr^rf 

[0 0 3 0] ^^'f 7> hn>fcf3.-^' 1 0 0«, 
h-"? — 1 0 4<&:^r-bTffi©3>tf3.-:S'ga{re;i^ 
n^iffs^fettt-.s. ^--y ^7-;? 1 0 fzt^ 

'f >^'-^^>j/ K. 'r>hv^->yh, □-;^jJl/-x'J 
7 ' ^yhU-^ (LAN) Sfcti^-f K • XU T • 
>^l.r7_/7 (WAN) h'7-i7S:^t?, tt^W 

(cSM $ n;^ e. y> s ^ i: :/o n > tf 3. - iS' p Sr-^tr d 
t^^'T^-S, ^5tc, hu-i7^a:>mm:^mt. tz 
t^i^imm^^y'M,. -f—^:^yh (IEEE 8 0 2. 
3), 1 — i7>^J>^(lEEE 8 0 2. 5) > 7t7 
T-f A-5^-ti[x-37U>i' • >iS'7x-X (FDD I) 
h* (ATM) X$>^o a>tr3.- 

figT t) J: V> d t tcSSt- ^ o 

[0 0 3 1] 1 0 4 75^e.1f#E 

*S*-r^i:, i^^-f 7> h3>tf 1 0 OtJ^S^ 

tf JL-^' 1 0 0*^e>OS*lC»'^f#, +)■- A*10 6«^ 

[0 0 3 2] — JliSJgffi{C*3ViT, +)-- A*10 6HWA 
Nl 0 Sfcj^i^^^fnTI/i-Sy-h'^/x-r^-^tr. WAN 

io8«. n^<D^y hu— i7 ■*)■—/•< 11 o^m-r^. 

hU—i^^—Ai 1 0 o -5 1tic©:3> 

tfa-— 5' 114 <£-^tJL AN 112 tr^lggS tlTV^^. 
it— /N'l 1 OO— OSfctt^^-y h7 — 1 0 4 4'K)ftil« 

h^-i^-y— A*l 1 0TllfT$n-5. *%0^CDSiJcD^JS 
?^ffiJr*3lriTtt, l2:^ilS?V7 h-^xTHLAN 1 1 2 
cDlti&©n>tfi-i$' 1 1 4Tl^fT^n^= 2^^BJCD^ 

i^7-<7>h3>t;i-iS' 1 0 ofci^sif-s. affifiss 

:^)i/2:^SJ?V7 h'^xTtjA'&CS^^tWfBltCi^ffit- 
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[0 0 3 3] III2tt, *5!Bj©ffia43j;t;Jx-^'«fi]cS 

[0 0 3 4] If fgiSB *fcttX>-T-^' ^--i"^ 

y'Mt^m^^^, x>5^-i'5=--i'^;i^ h;V*f^BX*5j;0:fie 
ffiT-5yp-feX«. H^fl (Caid et al)tc#-^sn 
rSYSTEM AND METHOD OF CONTEXT VECTOR GENERATION 
AND RETRIEVALJ t^f^. 1995^1 lfl21B(r 

mm-^ntz^m^n^s. e i 9, 70 g^icgi^sn 

[0 0 3 5] C1«X>5=--1' h;i/^J5£X^— 
■5. /i<i:;l^^'7— H'vWjSffl-e^, dODX^-Att— » 

M&dUi&i&i^^T, ^ViT->X7=-Att. X>T--Y-7^'i' ic 
'^i^ h;HcSc?ViTX>T-'i'-7^i"^i^ h;i/4:f^^-r^. 

[0 0 3 6] &lT©iJil^!c:j3ViT, rz3>v^>h^^h 

[0 0 3 7] &.r(DmBM\t, (1) ->7.y"A«fiKS^ffi 
Ui, (2) '7-Hzn>7^>h'^^ h;i/#Wt>^3--;k 
(3) -fe-;/->3>3>/^'f ^^rv^a-;!/. (4) U TJ!/ 

^'■1' Ai£ftii--/\*t>f^-;i/, (5) z^ay^—ji^i; 
hJPM*r+t--A^:>f3.— (6) x>7=-'i'7^-i'-^^ h 
;i'HSr-y— /N*tv'i-;K (7) fuy^-jl^is^H^x. 
>■T•'C■T•1'®^&y;^::^•JXA. (8) x>T-'i'T-'i"r> 

^yhUUDMam (n;;?, h^5=jU) , *5J:t>* (9) 
[0 0 3 8] (->X7=-Attfi£®^«tl») ia2(75-FgB^# 

^t>';L-;i'2 0 0 tt, ffl^igahu-x><:fzi-A7. 

2 0 2, 7, KyyjX h7r-l';l'2 0 4. fej;^^^ 
X'JX h7T'r;U2 0 6*^S'7-H3>T->h'<i7 h;U 

©m^f^fiKT^o X h-yyjx h7z'rjp2 0 4«, u 
— \^=i>y^>b^i7 h;i/#w^:>'i-;i^2 0 0/ii>*»i-r 



h^P h;u^w^:vi-;i'2 0 0 7&^-i^{ci^;i'-y'fb-r 

HOUX hTa&-5. hU'-X>i^a-/''?X2 0 2 

2, ;^ h-;/yjX h7x-rJl'2 0 4*5ct0^7P-X'JX 

[0 0 3 9] '7-H=i>5^>h^Syp-feX:*^^7f ^ 
M'-X>^:3-A'7>2 0 2lc:«^i9. X h^/:/'J 
X H:7r'1'JU2 0 4\Z\tfji\/^U-\^<D^n^tHZ-D^ 1 

'^-J^ 2 0 8 tC#ffiT-5. c:ne)C09-h*3>-7^>h'< 

5=-> h'^^ h;i^^PBi{:*5ViTiRi«i®:SrrR]S:fi-r:3 >^> 

f^®^-XiLT^tg-r^. '7-Hn>-r>h^i' f;1/ 
^^^T'PizXtt. IS^SfbT^P-feXW-gBtbTff^^n 

[0 0 4 0] ■fe':/->3 >3>/i-r7^v'3.-;i/2 1 0 

it. ■tyiy3>timj'-i$'^-:^2 1 2 iO^ ^.^ijfi^b^n 

7^=t^XhSr. -fe<;/>'a>S'JP7 7-1';i/2 1 5 0U7;i'5' 
'f A/A-S-y-— /N* (RTAS) ^:>?3.-;P2 1 4<D$lJfflla 

■7>Htc^^-r-5. :3>/U )V:fa-iz7.'p\ziS}-m^n^ 

mmmj.mmiz\t. ri7'r^yu!j:^<DWi:. ^iK^iz-o 

[0 0 4 1] ;!)CV>T, *%B^«§jE^©IO»BX>^-i'5=- 
^f^i? h;i/S;t«vX5^A4'Ox>5^^-5^-f ^fh^-r 
-5, cicdx>7^-i'5=--i"<^?' X 

>7^^'5^i'IB3z!i^-5'^-X2 1 6^\z^m-r^:^>T- 
I'T-'i'Wx^X hseaitc^o'i/iTVi^o x> 

J^>7-^y^-(^i^h}l^^&-t^fcii>\zm\'^'E>n^o X 
5^ACD-x=^^X MEizEtt. ^C0X>5^^x-i'A^ hJl/WlS 

h;i'ti->7.5^AI!)f^4'«cji'fbb^^fcj?), x^X'1'7^'1' 

7^ I- T-'i' C9-f-+X htBa5«->XxA»)f^{Ci£:^ST-«;^C 

m'^xi^^^o 
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[0 0 4 2] *^H^T«, ■r^X<DlA'B*^JEmtS.-^y^ 

vx\m.<. HfcjfiviAi? h;uA'r/'?-x 

[0 0 4 3] ifc, X>5^^'5=--i"^^ h;UT:/n-5"lC 

[0 0 4 4] *^Bj-e«, rL— tfica^^n^jA^tt, 
[0 0 4 5] mum2^mm\^-c. UTji/^'-r Ajeft-y- 

-A* (RTAS) tv3.-;i/2 1 4«3.— tffrSll^ig^ 

gTszi— y-'D>fcfa.— 2 1 Q\zm7fi'^^<D\zmw£ 

J!£^^SS?-r^. RTAS^Vi-;i'2 1 4tt, 31^75; 
'r^-7rs.±.^:jh-^m^^^. RTAS^v'a.— Jl/2 1 4 

[0 0 4 6] RTAS^rv'j.— ;l/2 1 4;&^, =i.—Vrifii7 
5"f 7'>h=i>tf3.-^ 2 1 9±TSS^CD5!?T (2 1 
7) , ^CDS* (2 18) . MSroWASfctt/A^ 
(2 2 2) r3gi^;-i'^>hj ^fTofcc: 

t^J^^bfca^, RTAS^i^^-Jl/2 1 4«Mff>^ 

■yfe-v$':/D7-i'-;ns»r-y— A- (pvus) ^vo. 

— ;i/2 2 4*fcHX>5=-i'-5^^'Hfrit-A* (EVUS) 
^:Vi-;U2 2 8 (C^fLTjUffi-r^. RTAS^v'i- 



-X2 3 443J;lXS53S7r-r;l'2 3 2^£rfiJfflbT. x> 

fj;X>7"-i'7"i' RTAS^:>'3.-;i'2 1 
4ttilS?L.;ti2:^<£i7^-l'7>h3>tf^-^2 1 9tC 

[0 0 4 7] P VUS^:v7a.-;l/2 2 4ti, RTAS^ 

v?i-;i/2 1 4i)-^i<D^mzm'^\^xn.—vf(Dfuy^ 
— hji/Srjgj^;sii-^. n.— »f-€•n^'n«y□7-^ 
-;^'^i' h;i/ttyp>'^-;i''<^ h;Px-^'^-x2 2 

— h;i/$rjgf&'r'<>htH]gf ^x>7^-i'7=--r'^ 

[0 0 4 8] EVUS^:-:^i-;p2 2 8 PVUS^: 

>'^-;i/2 2 4 tetsu— ©ibf^^fT^*^. i2;@ox> 

5=-'t' hJl'JiTTllj'f^-r^. ^X>7^>|' T-^ -^^7 h 

X>-r^' hJUx-^'-^— X 2 3 0 \Z^m 

^, ^©rt— t^>'aj?bytj2:^cDx>-T--i'5=--i"^i' h;u 

[0 0 4 9] M»5!^43<ktK^^ (RDA) 
2 3 6tt. yD7>i'-;i''^i7 h;l'7^-^'^-X2 2 6 i 

x>^^'T->i"<i7 h^i'T^— X 2 3 o®S:^ort§ 

Sr^giJ-r-l). RDA^rv?:!— ;l/2 3 6ti, Wffl;^cffi!lA 
[0 0 5 0] X>'7^-< 5^-i'^i7 h;i/®3SJStt->X'7^AC3 

^^'T-< V)vti^ii^'B^^\-^mr>rz=i—^(D^\z rn 
:^mm-i~:x.yT-^'T^^!7V)V(Dmm^'^m\z-r 

0^<Offi3^{Ct3ViT, ■^i' h;^©F'J7 ->x-T- 

[0 0 5 1] *B^Sffl»(cfB®-r«»* Li'^JIlEJ^ffitc* 
LT'Py^Al-fgTtflfS^nTfcO. jlftlcDUN I Xf^» 

->x5=-A©T-mfT;^n?). c. C ++. TCLtt. m 
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T V i s S ^ -y- :/ -> X X A f c o T ^ « -r -5 vi 1 1) T 
h:/ah3;i/ (TCP/ IP) i3J;tXRC p#cd^-<;/ h 

[0 0 5 2] *^H^tt, £i.T©6^»MIlJM?'j:i!!ia^v 

;i'2 0 0, •fe>V->3>3>/1-r7^v'rL— 
2 10, UT;l'iS'-1*A/K©-9— >'\*^>'i-^l'2 1 4, X 
>5=-'i'T-f"<i7 b;pj5ff1t— ;N*^:>'n-;i/2 2 8, 

M^%a*3J:tX^tfr*v?a.-;i/2 3 6T«.^o J|y.T{c, 

[0 0 5 3] ('7-H3>^>h'^i7 
)V) •7— HZ]>^> h'?^^ h;U^S^>?i-;l'2 0 0 
(EI2tr^-r) «. TT'U'Jr-e^g >:/Dy^A-f >^ 

^A^f^fig-r^o CWyPi^^A^, 

h;i'^S:/D-txS:fT'5. $e.{c, :i©ypi7'5'AWv 

[0 0 5 4] ■M3S{t;:^nTVi;^j;Vi-7^^X h*fettv>3i^ 
0 2 *tilJ5$n, n >T-> H'^^ V)V^mT)V^^) XA 

ffi©->x7^A«fies^tcj:siseffl{tiijssn^. 

[0 0 5 5] I1I3«. |l|2tCS^-r'7-Kn>7^>h^^ 

^v'i— ;i/2 0 o©fltf5!ia^:5^i-;i'3 o onxts^^ 

■5. 

[0 0 5 6] 1. KtKDm^ 
1213 ^#MbT, •7_p:r]>5^>S^i7 h;i.^g^>7i 



-;U2 0 otC'i^S75:A;'3 7 7-r;i'd^7'-b>:/;i/$n^, 

3 00A*7T-1'>'1'«, hl/-X>i^=l-;t7,2 0 2, 
X h<yyUX h77-r;l'2 0 4 43j:yC7U— XUX h7 

[0 0 5 7] *f*i:;^£^->>:i^;P;0^-iS©7-H3 0 1 
T^^a-^, hl^— X>ifa— /'?X2 0 2«, M'C.>0* 

)i^;/5:M/— x>i^a-A7,tt, rpield and Stre 
amj t V> 5 iE>0)3^m ©fB»43 J; 7 

h] UASC I I y^—-ry 

[0 0 5 8] 7. h>;/7'UX h7r-f ;l/2 0 4 (0245j; 

h;u^^^>JcL— J>2 0 Od^ffit^i-r^y— K. 
H®W>i-, 45J;C/71/— X®UX h$r#ty» 3>T->h 

fztpH^. (AND) J . ffSil^^ (NOT) J 

ri>:^^b (BUT) J 45J;IK r^O (THE) J 

^n^'^^Tfe^, X h<;/7'UX hr^r-f ^1-2 0 4«. 

*M«J?ifi$«s hi/— X>ya— /1X2 0 2{C4D^t^ 
iKttW(Cftfe«»{C»±-rS'7-H«*^2 5 0~3 5 0 

[0 0 5 9] 7!/— XUX h7T-1';i'2 0 6 (02:}3j; 

umsiz^-r) «. >>3i^;i/i:ixT&*Dn^^^'7 

bT, 7- HP>X> h;p^^^:>Sa— ;i/2 0 0 

rsan Diegoj tbT^a^tl 
:5^^Ti&-2)= 71/— XUX h 2 0 605|^§«, ^Wi^J: 

-a-tcioTgt^^n^o 7 u—X'j X h7T-r ;i'2 0 6 

tt, '7-H3>5^> h^i^ 0 OCD 

E«7S:it)f^^c«^£^^5T'«;^^;Vi;^)S. :^Mt£y l^-X'J X h 
S^efflf -S^ntX, ->X5^A(DttHg:^«rS]±T«.o 7lx- 
XUX K 2 0 6tt. 7T-r;i^4'05— fTtCC)^— X 

[0 0 6 0] 2. '7-Fa>x>h#SC0||fT 
M/-x>^^a-/1X 2 0 2, X h^^/T'UX h^T-f 
2 0 443J:at7l/-XUX h7T-r>l'2 0 6/&^-B.7-tr 
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[0 0 6 1] 0 3^#BgbT. mmmt^. '7-Ka>x 
> h^g^>'a.-;i'2 0 0©— gBtrfe^WMa^v'i- 
ji'S 0 ojCctoTfT^bn^o Hirfiast'/^-ji'S o o 

M^-->ya-AX 2 0 2 Sr^i^. ^fTCD"?- K 
*^7^-X'JX h 2 0 6^rz\t7.hyy'J7.hyr-()V 
2 0 4{ca&^*^i:5/0^^*iJ«L. ^©^-h'cDfgl^ib* 

$^7ri';u3 0 4 (lEiatcs^-r) {r»#jitj. mmtf 

D-trX«. h U'— z:>^zi— /tX 2 0 2 4'©'7— HW-^ 

[0 0 6 2] ig4tt. igi^A-y v'ix-:/;i/4 0 0 
T3&^, l§^;N->'>'i7=— :/;i'4 0 o«, 

y;Uf^fi£^:>7:i.-JU4 0 2(C<ktJTf^fiE^tl-5, IS 
$tA-y->3.5=— :7;l^f^^^>^rL— JI/4 0 2«. '7—}^ a 
>7^>h^^ h;U^W^:>'3--;i'2 0 OcDiimfigS^T 
ctTBT^T-f ;U3 0 4|^0-r^TWi§l^3 0 2 (c-p 
ViT, 5^-^'7-f-7^A4 0 4/i«l§#A-y->aL5^— y;i'4 
0 0 tC43ViTf^J^$n-5, /\y->3.^—':/)U-S.^rc, # 

[0 0 6 3] 0 5tt, m^^f h}U(owmiKm^i^j^-t 
■D\,^T(Difnm^mu, m-nmmm^^ (up no 

-JP5 0 0«, l5D^M'f^^=I>7^> h'^^ 

■5, UPNGtv'a.-JUS 0 Oli. J^— 5)-^SL^ 5 0 2 

(1 0 0, 0 0 0, Q Q 0-^-< i7)V^±) t 
iR^bX, fi,^CDSL?&:t)5!c^SS:<gffl-r^:i<t:^|tX^ 
^. l^-^^*SLi5:5 0 2S:fflViX, ^m^>'i-;i'5 0 
4«, -ferp5IZi^*5<J;O:#fit5J-m©#ttSrWr^;^'^7>0 
7>yA^S5 0 2 ^^f^fig-r^. >X h U—v'a 

(DSii©si^}ctijosxe)n«). ^(Dm^<D:ff07.^^ 



[0 0 6 4] BI6«, 0 2 »C^-r=i>T-> h^i7 hJI/^ 

p-^i'iaxab^, ^n,3i^:-/:i-;i/6 0 o«, 't'PBliSI^^ 

r^^l'S 0 4;0^e.ig$^«S3gcth$rfflf#-r^. mm=^i^3. 
;i/2 0 OCOgiJi^^S^Xa?)^, mm'^i^zi.-JVQ O 0 

«. +r^i§^:7T'i';p3 0 4<&sg^:^. 4" Pb1I&$^ 7 T-f^P 

3 0 4 4>©#X»t::*tt^#S&$*3 0 2%^^?:th»:-r 
^. ^^v^x. Stta^rv'i— Ji'6 0 o«, c:ne.oSEthS: 

fg|^A>;;->i5^— ::/;i'4 0 0iti©€-X— ^7-1't-A4 0 

[0 0 6 5] larti, 0 2 tc^-rx>'T-'i'X'i'SJ?->x 
mm^±\zm-:^<mn^>y'>h^i^ hJKDi^mik^^ 
p>-T-> h'^i/ h;i/©-?-n^*ntc-DViXfh»$n-5. * 

h)V^miET^o m7\t. «0»!y— X^4^Xh7 0 OSr 
^f. ■:P75^©*flM»g> V-Xt-^X h 7 0 Ottffi 
^D;a^^>--7^^X h 7 0 2 tcSl^^n^. v'X-T^AtJ. 'P 

>b-m^i3^U'p'b-mmzT5im-r^mn^m^-r^rztb, 

CintCj; 13 O -C> h* t-g-fhX 7 "7- b' Sr ilWr 

Ei7{cme.n^j;5ic. ':7^>H':7 7 0 4o4''i:> 
3S:»o«HasBx-a&So ^ns^^xtt, '?^'>K':7tt 

it^JitXfe^o rmaoj C4''il^<&«<> -^-OK 
■^7 0 4CD^iE'^i7 h;i/ti. TrebelJ. Tgro 
u p J ^JiZ^y U—X rsendero Lumino 
soj ®ia^tt^P>-7^>h^i' hJPcD'^i? KJl/MSc*" 
e;^i^o ig$^^ Tr e b e 1 J »c4''L^«:e<, "^-i" >h*'^ 

7 0 6 ©I^IE'^^ Tmaoj. Tgrou 
pj. rsendero Luminosoj ^^Xf 

Tbombj (DWm^m:=i>'T>h^if h)V(D^^ hJV 

m-^ti. dwyp-trxttMsaa^^T^^x h 7 o 2 ©& 

ig^fc*fLXigtt^.n^o &Sfffifitc43ViX. ^flE^ 
i'hJl'timW-^n, fSI^A-yv-i-T— :/;i/4 0 0 (0 4 

(rs^-T) »x-^T-i'^A4 0 4 4'lC'fi:ef ^««iiiE 
[0 0 6 6] 08«. ja{iMt--5i§$^^W^i' hJl/lCJcoX 

a&^o l§?^>'N-;/->3-7^->*';U4 0 0 jfiflM 

8 0 o«, 4>'L^i§$^^c:gfcJfi<iifi{y-r^l§$^lcMJg■rs 

^i7h)l8 0 2. 8 0 4*3J;l/8 0 6 lCj;oX)i;£;^n 
[0 0 6 7] ^T©^iCl~4IC<i;oX. 0 7(C^-ra 
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Eij = Nij-Tj 



[0 0 7 0] 



^CUXBEVr _ ^ACCtlMt/UrED ^ qCURKENT 



[0 0 6 8] 



[0 0 6 9] 
[ic2] 



[igc3] 



(1) 



(i> i='&SHRje»: 

(11) cetf.m.t =i»*^ j ©«:iE^i? h/V 



(2) 



(3) 



[0 0 7 1] 



(i i i) cj"™^" =»•^^>y->'^7'-5'/^f*-^M«fK^»il«$^tfclS» 
j ©SIff (running) -d-SMfiSE 
(iv) WS=R»f i'K<>-!hw'X 

(v) aii = l- ©,ei-e*,5»#<DlS#i*J:Vj OiSetflCi5«E3a*ifa 



1 ^ 
log(— !_) 



[S:4] 



(4) 



(i i) B=«^fi<){C*^;^nfc^M^$iJ1fl/15><-^ 
(i i i) NDi=l§$^ i ^^trX*©!^, 
(iv) TND= h^-n>i?'n— /'■?7.it'CD5:»©i^a 
[0 0 7 2] i^Tlw-^Sn^fC^5~9tt, 

mmmz-&s\-r^. ^-t h (ca i cd oiNffFtcgBsg;^ 
miE^mm.t^> :in?,©«]E«, M^-->^a-/i 

j,NEW _ jOU> j y Q ACCUMULATED 



:7T'f JU3 0 4 4>®"r'^T®ffi^$rabT^n^*n©>"? 

9tcWS^$n-S)T;i'=fUX*A«. ^i5i§l^a>5^>h'^ 

[0 0 7 3] 
[^5] 



(5) 



[0 0 7 4] 



[^6] 
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rpNEW 



\rr\ 



(6) 



[0 0 7 5] 



NSTEAfS 



[0 0 7 6] 



[0 0 7 7] 



[^9] 



\Tr\ 



(7) 



(83 



(9) 



(i i) T,*'*" ^^tE.(0^^:^<0JL1Si^fi1t1^iH^:^T>Y 
(i i i) r-^a* 

(v i) M=2F*&W»-<^ h/u 

(vi i) NS TEMS= M^— /'<:^tf<DH:fr©»»tfDi»Sjfc 



[0 0 7 8] 3. mtiyT-^)V<Dm^^^^ 

[0 0 7 9] (-tr^> >:n>A-r ^^>?:x— ;P) HI 9 

[0 0 8 0] 1. ^^7.h^^i:^>'7-^9-^^i7 h)\^^ 
V3 >n>A'i'^^:>?^-jl/2 1 OTi/^'T-^X hCDlffg^ 

^^:v^:x-;u2 1 0 ^c:c}:oT^Tt)n^^!la;S:^J7S■r 
^o HiriEa;Ji^:>f3.-;n 1 0 o«. x>-T*^-T*^iaaix 

X2 1 6 7^^ibX>^^5=*>('fSai$:ggtro tif^aS 
^S/rL— 1 0 0 12 2 tc^-rir^>i/3 >=3>/t'i' 



-)V 1 1 0 0 ti. 0 3 tC:^-rM5!131^>?:i-;i/ 3 0 0 CO 
-gBi:bTfT:bn^mf^E!l31<i:|Wl^tTab^o mr5!l3iqE>^:2. 
—)V 1 1 0 0 ti, X>'7^>< 5=-^ ffiizE-x— ^'^-X 2 1 6 

e> i nfc^^ft CD ^7 - H h yj X h :7 y ;^ 2 

0 4^fc«>'l/-XUX h7r'Y;^2 0 Q\Z$>^t^Eo 
;5^*#iJ€-r^o ;ifev^T\ ^?;{i;^i:f&$^3 0 2ti. x>5"^ 
"T^^^ h;i/j^^£^>^zL-;n 1 0 2 tCct-pTiSEffl^n 

^ny^-yh^^ h;i/5^-^^-x2 3 4\z^m'^n 

[0 0 8 1] ^^1 0«, X>5"^5^^^i7 
2 1 OtCJ:'DTfT:bn^yD-feXCD^JT*-5o X>-x^ 

[0 0 8 2] 
[^10] 
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(i) ECVi=X>-x-f i CDX>T--r5^>r:3>'7^ 

(i i) SCVj=i§l* j ©i§$f=n>T->h^^ 

(i i i) TND= hU— X>^:3-/'^7.4'®5:SCD^ 

(iv) NDj=§S^ j S-^tf M^-->i^=l-/'^Xtf 

(v) NSTEMSi=X>5=--i'5=--Y i OtEizEtf ®l§^ 
[0 0 8 3] 2. yyiJVm^^^ 

>-5=-^'5=--i')M^?f I'RTAS^rv^a.— ;l/2 1 4tCJ:-5ffi 
miZltypm^X'^^tilti. x>7^-i'5=--i'ii*?7'D-b:XSr 

tfi$ltt«RTAStv'a.— ;U2 1 4 i;:«j2-STr«;i£< , 

n-AX 2 0 2T!'O^^^S{CJ:-r)THfIt)oTthe.n 

;i/2io«, :icDj;5{cwsi$n, /6^omfeoTfi-^.n 
7"f;u2 3 2 (c«g-3^itro 

[0 0 8 4] 3. -lr'y->3 >*W7r-1';i^^fiS; 
01Ob«, -fe^/v^a >ffiim7r<;L'2 1 5 <£;^fig-r-5 

/^-f 7^:>'rL-;i/2 1 o®±7i^tg«, ■fe-ye>3>BBai 

7r-l';l'2 1 5 lC-^Sn-5:t'<U-377)^ff^Ufe-fe<>'>' 
3 >mm'^^>^-t'y->3>Mmyr-f)V2 1 5 Sr^fig-rs 
^:tl?*-So -b-^v^g >*J??:7 7'r;i'2 1 5tt> /S^il 
S?:/P-tX4'(CRTAS^:v'3.-;p2 1 4^:^-1' HTS 

>mWyr^JV2 1 5tt, -fe-^/va >fBai7r'r;i/2 1 

hj\^(o-ty h*#tj. ■fe^^sva >sinapy 7"r;U2 1 5 



(10) 



It. mmzm^r£}Kp<Dif)i-y^m'iL. evux^ 
i^^-)V2 2 s-^mi^'^mx'mj.i^^'^iz, nv'^T-v 

^, •fe-;/->3 >fBai7r'f JU2 1 2 cfO-fe^yv-a >1f?S 

\t. mmi^T^'r'<-:riiti^(r>\zmm£.fl:^^<D:Ly7- 



yu-{ix\zm'3<^i7 hjiy 

(i i) 4t^cDjSe®x>7^^'5^^'^i' H;KcS-C3*<'< 
(i i i) ^l-gB^T-f ;i'(--^^n^x>5=->i'5"i"<i^ h 
[0 0 8 5] ^fc. -fe^yi^a >r]>A-l'5^:vn.-JI/2 

io«, -r^T07i/7-^':^;^x>-7^^T-'f tffsco^sw 

ilH)TT-$)^EVUS^:v';i-;U2 2 8 (EI 2 tC^f ) t 

;Kix>X'r h-jl'7'-:$'^-X2 3 Oiz^m-^ 
n-5fci*. EVUS^v'i— ;l'2 2 5 t-eit^tiSo 

[0 0 8 6] (U7;i/^''rAjAe-y--A*^>'i-;i') R 

TAS^:>?3.-;i/2 1 4«. ^t^^ tSc/A^WSJU— ^^-C > 
^nofzHblZ. -r >^'7ai-X<D7yU^-->3 
i/5A(API)^ei56<jSfc«3S|iiiy7 h-i7xT7yU^r- 

->a >n?y:mb^if«-r^o RTAs^vi-;i'2 1 4 

(S, ■fe>;/->a >SiJW 7 r-f;!' 2 1 Scftc-fe-y h^n;t:^f 




[0 0 8 7] JA^ilS^yP-feT.*, RTAS^v^:x-;U 

[0 0 8 8] 1 . wmit 

RTAS^vji--;^2 1 4m]]mit::i'r>\^^^»m^ 
-:/;u*S]W'fl:-r^o :;^ViT> rtas^v:x-;^2 i 

4ti. -tr^y V3 >$OTy r-r;^2 1 5c^f^^tIJ:r:»Tl# 

3jc-r^o RTAS^vi2--;l/2 1 4tt, EVUS^i^oL 
-;l/2 2 S^^LXJi.yv^^'r^^^ hJU'T-^^-T. 
2 3 07J>^^Ti7 7='^ y'U:x:>9'^ 7=-^ tc:-::>ViT<7)x>T* 
h;l.$:^^L, RTAS^>^a--;i/2 1 4rt 

^T-r^^. RTAS^v^^-JP2 1 4tiUT;^^<A 

[0 0 8 9] 2. OL-iffra^^ h;KD^^ 
3.-1fl&f^^^>1r->5;^f^:i7^-rT>hAP I ^:;M.Ti- 
^.^AtCA^th. RTAS^rv^oL— ;l/2 1 4^1. -f-On. 

^ffl^n^o RTAS^>?aL";i/2 1 4^i. :i-—1f ID 
^PVUS^>^:r— ;i/2 2 4tCigt*o PVUS 

^>^zL-;i/2 2 4ti:/p:7^-ji/^^ h;i/T'— x 
2 2 6^^i^^<D:±—^\zmM't^yay^—)i'^^ hJV 

V^Tt). RTAS^>^^-;i'2 1 4tit^gg-r^»f^tC^ 

AS^>^^-;i/2 1 4rtOF^gE^^u-T— :/;i/F^tc*&s^ 

[0 0 9 0] 3 . a--if fTldt^Offi^ 
RTAS^>?a--;i/2 1 4^i. ^fe, rL— tf fTiUj^ji- 
\t. m2\Z7jk'r^o\Z. ^x:/^->^g*2 1 8, ^fc 
^i}l^BS^2 1 7;&^*^^n^o i7^^T>h:n>fcf:z- 
^7 2 19ti. ^^-f y > hAP I "t'COffi^^nfcfTlid^ 
^Wi/J/^^^^' h^M-^o RTAS^v:!-— ;U2 1 4 

[0 0 9 1] 01 1 EI2 t-^fRTAS^i^n--;!^ 

^rz\mm^7j^2 1 B^^t^m^. rtas^v^-;^ 

2 1 4<^— gBTfe^^->^Zi>7^>h^i7 h;u^^^>? 
rL-;H 4 0 2«, S5K^n;^c^-vc^ I DtclBiir^ 

:$'^-X2 3 4;&^e)^^r'5»o RTAS^i^rL- 
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-If I Dlz^'Dxmi^^'^^o 

[0 0 9 2] mi2\t. m2\z7!k-rvT)ii?-(j^jiiB^ 

^^'i^lllTS)^^ i75<7>ha>t!n.-^^2 1 9*^*:i- 
1fM^2 1 7#0:i—tfa)tfi!j*S^-r^«'&. RTA 
S^rvoL— ;i/2 1 4{tm^mm\zm^^'^rz:x:yy^^ 

^^hji^mmr^Tzisb. mmyT-()i2 3 2<D^^v 

;^-i^^mmT^:it\Zj:'oX. m^2 1 7^=3 >7" 
>h^^ h;^tC^Jl^-r^c RTAS^>fn--;i/2 1 4c;0 

-*^Ta5^tt[^Ji^>^n--;p 1 5 0 2 X h ^> yj X 
h:7T-f;u2 0 4tc4DV^TfSsij^nfc^a<D^-H^Bx 

-H^3a^'gr:bi^> :x-1fSg^2 l 7^<Dmm'r^T\z 

^^^^Tmn^tfO^iX^frOo ;i>:ViTRTAS^>^:x" 
;i/2 14ti. ?^S;x>7='-^5=-^ :3>7">h>^C/7 hjU^>? 

5 0 4;&tttfa!UfcS8#2 1 7 <D^^^^(D::x- 
^ I D trnzmi^-^i^^C tlZ^^T. ri.— lffTSl^i7 

[0 0 9 3] 4. i&7j^-t^(D\zm'hJ:,\^^X,>^^5^^(D 

EllSti. 02 t'^-TRTAS^f^rL— ;l/2 1 4 tdcto 

HTafe^o ^5'-rT>hn>tf^-i$'2 1 9 {m2\,Z^ 
f) ;O^ZL-iffTib^|i^bfj;V^i^^, RTAS^S^^- 
;^2 14^i, }ft^t~^(^tCSfei:V^X>7=->i"7^^ ^jM^ 

^— X2 2 6 75^S(Z))a^:x— ifya ^'^^ h;i/^ 
fflV^^o ^^-r7>hn>tf^-^ 2 1 9;0^M8gMfTa 
^ffi^r^^-^. RTAS^:>^rL-J^2 1 4^i, ^C0« . 
^^tlfe^.— 1ftT»I^. S^-r^CDt^:gt)J::ViX>'7^-Y 

[0 0 9 4] RTAS^vo.— ;l/2 1 4«, BE:!— If 

>®JW:7r-f ;^2 1 5 {CctoT^^^tl^r^TODT^ 
T-^ ^UjK»\zMf^^^ hJlimo)^-^ t bTffli/^ 

±yiyB>mmyr^)V2 1 5(D\Hm\t. wmit^ 

tCRTAS^vrL-;i/2 1 4tcJ:-pT^^U ^'t-P— F 

7 7^;1'^rtas^:v;l-;1/2 1 4<d^^u \zm< ^ 

[0 0 9 5] SSS13*#9iLT, RTAS^S^zL- 

;U2 1 4^5. fTi&feJ:0;:i-if^i7 h;i/Tx>5^^ 

x^^iiS^t"^ (t*t^l 6 0 0) o RTAS^vn.-;i/ 
2 14^^. tt^f -S^i? h;i.i-r^Tco;r^'7^^ 

cfcoT, gg^yP-trX^ff 5o RTAS^:V:i-;^2 1 
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4 miM(D^i7 hjy^imm^m^^^ z. td^T^s*^ 

[0 0 9 6] 6 0 2-t?, RTAS^:>?3.-;>2 1 

-\-j^timmk7r^-^nx\^^^m^. RTAs^v'i-ji/2 
i7H»-r^ mmi e o 4) , 

[0 0 9 7] ±jzBLfeffiij;^*Stt^«3e{KX>'7^-f 

-r^t>%jj:^-Amigi^n^t. RTAs^:>?i-;u2 1 

4«AP I ^£:^i-bTS#iL;fc/2:^® I B^i^y-fTyh 
n>tfi— 2 1 9 Cj^f . ^cD I Dtt. r:7x::/*:fMx 

i'^-rT> hzi>-fcfa— ^ 2 1 9 (Cj;oTfieffl^n-5, 

[0 0 9 8] tttgSrr6]±Si±SrcS?)iC, RTAS^i^rL 
— ;i/2 1 4«Ti7 5=-^:/-t:>;/>'3>$iW7 7"f;i'2 1 5 

— h^— B###-r^o RTAS^:v'3.-;i/2 1 

4«, ^S$tlfeX>7^-l'7=-^<^/tde)fCEVUS^:va. 

[0 0 9 9] 5. X>5=--i'5'-i'Jf*tC*t-r-S>3.— 

>^ X A ® jM^ $ n;'5:;2;fe ?r la^^)A^i^c X 

<®'lt#S*^*bfc«'a-v ;n®^^«AP I Sr^n-bTR 
TAS^:-:^3.-;l/2 1 4{;:^im^n§. b*>b, f'^T 
(DjKBm7r:tm-ri^i>RT AS 2 1 4 ^ 

[0 10 0] 6. :i-it*fT»i^i' h;i/(Z)HliT 

RTAS^rVi— ;i'2 1 4 S^^nfcn.— tf iftf^^ 

bT, -s-wa.— tFfct^ViTwyp^^'— 

frf'S, RTAS^-:^i-;i'2 1 4«, BM:i— tf:/D 

U^m^$nfc:x— 1f fTi!)-^i7 h;i/^ P VU S ^: 

2 2 4(Cj^{fr^o P.VUS^:-:^^.— Jl/2 2 4CDi!;{^5: 



[0 10 1] 7. iK^tti.t)^jiy7-^y-^^^ V)\^<^ 
Miff 

a--- tf;5ix>5"^'^^ (/£^. i7-7j^>Sfc«»l5l)tC 
jSig^b;^c«-&, ^®x>T-i'7^'("<i' hJU*3J;t/^^— It* 

1 DAtM®f®;tiiii{c:E vus^ri^i— ;P2 2 stciHii^ 

(iai7{c^-r) . i^v^^-e, Evus^vi-;i/2 

2 8 tt, x>5^-i' V)v^=i.—^(Dm^-^nrzn 

2 8 0«;{^«t;TlClpaiTS. 
[0 10 2] (7'p>'^'-JU'^i/ h^l'MSr-y— A*^:>?^ 
— ;!/) pvus^v'a.— ;i'2 2 4tt. •:fuy 
h;U5^— 5'^— X2 2 4{c#sn-5^— +f:/D:7-i'-ji' 

[0 10 3] ZLi\^(Dn.—vf^-:fuy ^ hM-t. 

(i) *f^<75Ji:^. i7-7p>. * bffl^oitKltffi^rL- 
tftCjES&^o 
( i i ) OL— ifff idW^W 

(i i i) 3.-- tffT»<t;SS. MiPp*3J;^^-y— t:x?S3zE 

(iv) =L—v^-:fay^--)V^i7V)VhKu^mmx'f 

(v) igR^WJm.— y-'frffijcDjilKf 

(vi) @^:i9'5^3.-iff^iti(D^ffli)^:7';Ht;*5±tKr 

(v i i ) =^m'^7')v^m.mit\.. s=a$s^»?r^tt 

[0 10 4] :*:^B^©iffSbVi|IJEJ^^T«. PVUS 
^:v?3.-;i/2 2 4H, i'kv-y h*- KlCj;-5»ABS 

»A^CDSa®1t$fi*l^— -fb^nfc (unified) ilS:;^7C 

^PBi(ciK$bTVi«>fc«e), zL(D'^mL^^w,\zm.^]Ltiz. 

[0 10 5] PVUS^v'n.— ;l/2 2 4«, TCP/I 

^^AtbTllM^n, ;iCD«fce>i^£g*('*tbTJEr^«§ 
^fig-r*. PVUS^:>J:3.-;i/2 2 4tt, — PtAiCDtl 
ae*)/i5^-3"^— X$r#b. JltlttHWCD^— if I Dt 

^ne.«i'5'rT>ht'J:oT-ocox>-T--i'T--i' 
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y^>zjLa-\^^\Z^>yj^\^yh»^^±\^^^^o m 
[0 10 6] P VUS^>^a--jl/2 2 4^Si^T^C?iJ^-r 

[0 10 7] 1. mm=i--^fuy^-)v^^h)v<D^ 
i^7.^i^\z^n^:jL-^\zu^n'^n. @w<7)aL-ifi 

"1fcD<>^-^^^> ho I PT Hl/X7^?\ abSV^t^y^ 
3^-^— X 2 2 6 tC^*nTVi?iVirL-lf I D^f^SJ:^! 

^**^fTt>nfc«^, p vus^:i^aL-;i/2 2 4fri*^*a 

V)v^. mzmmy xj^\z^-Dxm 
m^n^ (Ell 9 a*5cfctKEii 9 bt'^f) mmm::^ 

[0 10 8] 2. :ju-^^uy^-)\^^^h)V^^W^ 
P VUS^rv:i-;i-2 2 H^c^n.— if I D ^^ffl 

x>hu^l> 7'p:7.<-;i/^i7 h;i/'x-^^-x2 2 6 

+ Oltfg^<^7p^>5'^^t^o P VUS^S^zL— >H/2 2 
h;UCO^*;0^*RTAS tvii.-;i'2 1 4/6^6TfeS®^ 

\z\t. p vu s ^>^^-;u 2 2 6 ti:;!55:<7)<5gffl<^;t5&tc. 

^(DZfuy^-)l^^ h;U^RTAS^>^:a— ;i/2 1 4 

[0 10 9] 3. n.—^yay^—Jl^^hJKDmjiB 
P VUS^va.-;i/2 2 4ti, :a— tf c^fifffijtC'^l/^TCD 
\^^<^'A^<Dmmizm':^^^T. zL-^^uy^-)V^^ h 

^■^ v^mm^n. =L-^tmi^\^rzm^^^ ^^^y^^ 
m<D^n^n\t. =i>7^>h^^ h^i^t-^^^n, 

[0 1 1 0] lai 4tS. EI2 t::^-rP VUS^i^zL-jU 



2 2 4C0yP hjl/jg^ST'P'lrX^r^^iJ^-rS 
yp^^'izHTS^So P VUS^>^iL-;l/2 2 4tt. 3> 
^>h^^ hJU^CO^fl^SS^ (TQCV) ^v:i-;H 
7 0 0. i!jf^^P>7=->h^i7 h;U{-^^fl^-rs (TAG 

V) ^va.— ;H 7 0 4. ^uy V)V)]/yi; 

Ty^ (PVL) ^:>?:x-;i/l 7 0 6 *5ctr/y P 37 ^ - 

;i/^i7 h;i/3aj^ (PVA) ;n 7 0 2 ^^tjv^ 

<^;if^(^lim^S*S^t;o :i-1f;if^M^2 l 7<^vX 

I D;^f^TQCV^v:i-jl/l 7 0 OtCjg^nSo TQC 
V^vrL— 1 7 0 0 tt^COM^X h 'J >yS:, 13 1 0 
blc^t-yp-t:X(hR*ttcBg^p>7^>h-^^ VMz^ 

VA^-JzL—)i^l 7 0 2\zm^n^o PVA^vo--;!/ 
1 7 0 2ti, i^TtCiJiBJ^n, mi 9 a*3j;n^iai 9 b 

t3^$nsjgf&T;wp*uXA^fijfflt* So yp:7^-;i/ 
^'^r-;!/^^ h;i/x— X2 2 etctf^iiti^, 

[0 111] rt— tf^^^ijS^Sr^U 'y^J7LfcD, ^;^cti$!! 
&^mX2 2 TACV^rviL-jH 7 0 4*^ 

vus^>^^-;i/2 2 4rtT;>^^u tc$>ST*— 

^Ty:f^^VX. x.y'r^'r^ I D^a >5=*> h^^ 
VMz^m^^o ¥fTUT. :i-1fID^i. t'p^'^- 
;U^i7 h;i/7^— ^5^^— X 2 2 6 t!?^ if oyn :7 

P VA^>?^— ;i/l 7 0 2ti^ine) 2 0C7)^^ h;u^Bi 
1 9 a*5i:lXEIl 9 h\Zt^m^n^m^>^7)Vd[^)XJ^\Z 
Xtif^o 'A^^X. yuy>c-)l^^h)ly'—^^-7s 
S^r^s^^i-^H 7 0 4^i. mcomm<Dtzii>\z. ^<DM 

m-^nrzyuy^-ju^^ V)v^'fuy^-)v^^ V)v 

T^-^^-X 2 2 6 tcS^iitP. 

[0 112] 4. Kn^m^Wi^^TS^^i'in 
^< c7)j£^4Dcfc?>'ir-;i/XTyU ^-va ><^f::*fC. 
^#:c^rL-if^ffli(W)^ite:flA{'-::H/^T(DAP^«)/t^ 

tr^sv^T, n.-ifgg^tifT*3n/ci:v^*^\ /A^^^^ypy 

hJl/^^t^TbX, :i-ifAP$^^-rSo 
:in^<Dyp:7^->il.^i7 h;i.$^^LT, :i 
-ifcD^S^. ttSU, m^iRA (HHI) tDct^fficoAP 

tl. ^<7)«jf^fcAP¥61)^5^;^^&.m^i2iOJ:"5ffllC7J/^*b 

TSSo ^ne>coAP^M^x;i/^ffifflTsJg^. :i- 

ifcoft[a:i:#:c7)AP^«lA^;<-^^«^U. ^ffl b 

T, yP:7^— ^/s;-;;^ 2 2 6 ^^T^C^ 
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[0 113] Ell 5tt, EI2tCS^fM«. ^M^i^^XSm 

-X 2 2 6 ^{z-^^n^Kkmizmm-^ntznw]. m<s^^ 

^-^^-x 1 9 0 4^^bT. i^.kzsyay^—ji^^ 
^ h;i/^— X 2 2 6;0^e>c7)yp:7-Y— ^I'^^i^ h;i. 

T. ^5^;Hb^>^:x— ;H 9 0 Oti, 

— 1 9 0 6 lC;^^$n^o ^fflO 

^5^;Hb^>^rL— ;n 9 0 o n^sv^T-ffiffl-r^r (h/^^T 

H I T^^o 

' [0 1 1 4] Ell 6 P VUS^>?rL-;i/2 2 4;0^*A 

□^651ffBTyD:7-r-;i/^i^ 2 2 6 

PVL^i^:x-;n 7 0 6«ya:7>f-;i/^ij7 hJUo"- 
^^-X2 2 6 7it^?)^o:a.-if{cMS-r^ya 

te/a.— ;U2 0 0 0 \zmr^o ^-ffl'J^^JVffl-ai^v^^— ;i/ 
2 0 0 0^5. tf-/D:7^-;i/^^ 

— X 1 9 0 6yi>^^cD^5^;i/^x;W^^;><— 

;i/M«f^^^-;n 7 0 4tcJ:oTyp:7^-;i/^^ h 
)\^'f—^^—7s2 2 6 tc^^n^ifisiciiia^n^o li 

SP$n;^crt^ti. ;A^ii*?^tCRTAS^>^:n.-;P2 1 

[0 115] (x^'T^^'T^^^^ h;HE§fTit-yt^v^ 

— EVUS^>^3--Jl/2 2 8 ti. X>7=*^'X^^i^ 
X 2 3 0;^^e)OX^:^'x^'7^^ ^p >^^ — 
US^>^rL->ll/2 2 8^1, X>^^'T--<^i7 h;i.-x-^ 
/^-X2 3 0 ^^^. :fect:r/*#iAtj;ta6co. vX-t^A 

[0 116] E VUS^i^:i-;l/2 2 8 tt. ^> h7- 
i7z/ahajl (TCP/IP) ±Ti7^^7>h70^eo 

— -r? J!JA±a)^fT pJtgT^j: =1 > tf :i - ^ y D ^ ^ A /0> ^ T'ci: 
E VUS^v^zL— ;i/2 2 8tS> H^C0X>-x^5^'< 



^ ;^ - & ? I # ^ CD iciseffl 

— 0 (7)4^365 ?^J:x- ^ ^- X S: ^ L T ct V 
[0 117] lE^Wli^^lZ. EVUS^va.-;i/2 2 8 

[0 118] 1. j^y^^^^mxis^zswm 

E VUS^v:x-;i/2 2 8tS, -fe ^> >^ 3 >r3 >/^-< 

>^^— ;i/2 1 0co3-^> Ht::fS^lxT, ^UViX>7^-< 
5"^-r7i:b'e.;2;S^»AU. *i^x>7">r7^^-r;^cj:*:»^ 
;a&^x>^^7^^^^ h)\^y'-^^-7.2 3 0:6^ e,® 

v-H >P>/N"-1'^^i^:x-;i/2 1 OHEVUS^f^n- 
;i/2 2 8tc^ffrrv>F. fr bViX>'7^^ -7^^ h;i/ 

A-f ^^v^o-— ;P2 1 0 fri, X>'T*^5^-Y^^ h^l'X— 
^^'-X2 3 Oj&^^I^T^^^y^iX^'T^^i'^^'^^giJI^ 
T^ct'^. EVUS^>?a--Jl/2 2 8 tC?^bT3T>H 

[0 119] 2. Ji>^^T-4^^ h)l^<kW^'y^- 
E VUS^:>^^-;^2 2 8ti. '>X5^A + C^f ^T07 

y;^j:x>7^>r7=*-r.fcoViT<7)^ftco/N"^^— ^fe 

1 Dfct:)V:iTOx>-7"-r ^^^i^ 
-^^mm-r^o RTAS^>?3.-;1'2 1 4<^^0^ft 
4^, RTAS^:>^zL-;i/2 1 4^t. RTAS^i^^-;!/ 

2 1 40;<^U^C>(SJt*r^fc<*tC> J;DSifi<DX>7^^ 

>K^, EVUS^V3--;i/2 2 8tc2l{f-r^o 
[0 12 0] 3. x>'T-^'T-^ yp:7^— h;i/co 

017tS. EI2(C^f EVUS^v^-;^2 2 8c^X> 
v^^^^^^ h;i/iS^£;yp-feX^0iJ:^-r^>^p^;/^BIT 
E VUS^>^^-Jl/2 2 8ti. n— lf>^i^X>'T--< 

^0 E VUS^>^a--;P2 2 8«. X>'t*^ h 

;i/®iS^v3--;i/2 1 0 0. :3>5^> h;i/-\o^ 

(TQCV) ^:>?:x-;i/2 1 0 2. X>'x-.<5^-r 

h;i/;i/^>i7 7^7:/^>?3.— ;i/2 1 0 4. y^uy^ — 

hJl)Vyi^Tyy^i^:iL-)V2 1 0 6^^ZJ^X.> 

T'^'T^^i^ h;i/^-^'^-x5»f^v3.-;i/2 1 0 8 
[0 12 1] mmmmt. y->ig^2 1 1 ^xti-r 

m^m^-r^t. mt>rL^-^m^2 1 imomm^m^ 

^Z.l.rz:x-^W]m^±C^t. E VUS^>?zL-jU2 
2 8[^. RTAS^:>?zL-;i/2 1 4 ^j^liR^tlfc/AS 
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[0 12 2] n.-- tP*<ia#2 1 7i&^5t^bfc«-&. TQ 
CV^v?ju-;l/2 1 0 2«-tCDi!jf^^M^:3>T->K^ 

^:>'3.-ji/2 10 0 \zm-to 3.— y-**^*^^ U >y ^T.;!' 

h;Wl'<vi7 7-;/y^>7rL— 1 0 4;&tX>5^-i'-5^-f'^ 
i7 h;i/x-:S''^-x 2 3 0*^e.SJ?$n;tx>7^^'-r^ 
(Dx>-T-i'T-'r^;J^ h;u<&^^T^. x>-7^-i'7^^'^i7 
h;p;i'>vi7T'v7'^:>'3.-;i/2 1 0 4tt, )iS5^n;tx 
yT-iT-^ <D^i; h;i/*:x>7^^'5^w^i' h;i/3@^5^:>? 

i-;l'2 1 0 OtCit-To 3.— tf I D*tEVUS^i?i- 
;i/2 2 8 lC)a$n:i5:«'&tctt. yu-y ^-)\^^^ h;WP 

•^i^T'vT'tv'i— ;l/2 1 0 'oti^-fUV y(—}\'^f7 V)\^ 

y=— ■5^-^—7. 2 2 Qi)^ib^<D:x—^<r>-:fuy^—)V^i; 
i5i:{cx>-T-^'5=--i'^:^ h;i/iSj?::^>'i-;i'2 i o o 

[0 12 3] TQCV^Ev'i— ;i/2 1 0 2fj^>bXtS^'Si 

;i/2 1 0 4. :/D:7-f-;i/^^? h;u;P'7^T>;/:/^-:^3. 

— ;V2 1 0 Qid^U:i.yy--('T^^i7 h;U3gJiS^:V3.— 
2 1 0 0 Ell 9 AH^Um 1 9 B t'^-ri^^^fT 
3. X>5=-'f T^f'^i' h;i'®fB^:v^-J>2 1 

OOtt, ^®S*fr$tlfc:X>5=-')'-7^i"^i7 hJl'^^WX 

*tX>5=-H'7=-'f^i7 hJl/T^— iS'^— X 2 3 otct&s^^n 
-5X>7=--Y7^i"<i' h;l/7'-^-^-XS«ff^:>'rL-;L'2 
10 8 (CjgE-r. 
[0124] 4 . P#raS»r 

EVUS^:v?:i— ;P2 2 8«, — 
i?*ifi)?-^®B#mt^*^M^nTVi^X>5^^'-5^>r I D® 
'JXh<£^^-r^. C«)1f$B«, RTAS^:v'3.-;i/2 

1 4*i«ttJ*-r^EVUS^:Vi— ;i/2 2 SCD^^UH^ 

-f A X iJ? > y ij 7 U ->3. a -7 > h* 7>t R T A S t 

v^zi— ;i/2 1 4*^e.i§im^n-i)<i:, EVUS^v'i— ;i/ 

2 2 8tt, X.yj-^'T^ I D, ^M^n^cT-l'^A®'^ 

^— ;i/2 1 4tciaiffi-r^, ;i®tf$R«x>7^-i' 

7^l'3M#^yD-fe7.{C^ffl-rS;'t«i){C, RTASl^aUp^^: 

[0125] 5 . ffiJ««S 
E VUS^rVi— ;l'2 2 8 tt, v'X5^A{Ct5tt.5-r'<T 

-;U2 2 8«j£^il^X:3 7(D^n^-*n$riiS-rSfc 

[0 12 6] (3?'p:7-i'-;i/:}3J;t;x>-T-^'T->rjiJ£;7 
;i/rruXA) igi 8«, a— !fR9^2 1 7 (E12{I^ 



-;i'2 2 4t3J:i;^EVUS^:>?i-;i'2 2 8©M;^tt, 

-^5? h;i'*3j:c;Jx>5=--i' x-T '^i' hJP^il^k^-ii-^fc 

[0 12 7] tt^2 2 5 OTte^O. PVUS^->*i- 

;i/2 2 ^\-mM.(r>:x-^m<k2 1 7^ca-:?^iT:/P7^• 
h;i/*H»f-r^. 9i^tt^2 2 5 2 tc^o. a 

V}\/fS^:sLy7-4 7-'i^^ h;utlt«^^ti. T^ny^T^lL 

XPT®«5*^i§Vi«'&. P VUS^v^j.— ;l^2 2 4« 

AW h;i^*Hff (ttSl2 2 5 4) -r^Jc^jt 

X4't"'^TC0'^i> H;P/5i|^i;x>7^-i'5^-i"\i7 hjHo^S: 

2 2 5 8-^, ;£^*^*Sg^XPTtSt^l^TS*?^n^. 
[0 12 8] gt^4^^2 2 6 OtCii^^)-, ->7.7^A«n.- 

fitt^2 2 5 Ot'iSO. y-'M^tC^^LTiiJS 

VUS^:>'3.-Jl/2 2 8*i:i— tfR8^2 1 7 ®ff Ift'^i' 
hJUTilW^nrcJ^SW'^i^ h;i.>£Mfr-r^ («^2 2 
6 2) , t*J^2 2 6 4 {CtJViT. PVUS^rv'rL 

— ;U2 2 4*«^cDj2:e-®x>-7^^-x^"^i7 h;i/T:/P7 

^_;i,/s^^ h;U*Mfrb, 4^^2 2 7 4(C^-5, 

[0 12 9] m^'&mm.2 2 5 2S:#flSL.T. T'p:? 
^'-Jl/XPT3&^fil^;^PZJ;0fei^t:»«'&. *^«2 2 6 

2 2 6 6{C*5ViT. T'P ^-T — ^I'Xr] 7#tt{C«koTil 

s?$nfci£©*^i:7 7'rT>h 2 i gjcMffl^ti^, 

ttffi 2 2 6 8 fCjti^;-. ->X5"Att, :x—tf ^tlfc 

jA^SrjM*^b;iA^o/tJl'&. >'X7"Att«fii2 2 5 OlC 
MO, ^omtc:!— y-'Hg^^Sft-r-StiifS^P-bX^r 
jioii-r, n.-if/05/2:s<&jiis^brc«fr. pvus^i^ 

i-Ji/2 2 4;ii^^©;2:^OX>-7^^'5^-f"^i' h;i/T7'P 
^^--jl/^i? h;i/<&|gSrT^ (^^M2 2 7 0) . 

E VUS^:v'i-;U2 2 8/e)i-?-05n.— tfB?,^2 1 7 
[0 13 0] *^^2 2 ^A-^tz.\-mM2 2 7 Ati^<b^ 

yy. «fi8 2 2 7 4{c:tev:>T, ii^j^nfejA^fcHji-rs 

PX h^:x;U7)^S«T$n^, ^^ViT?->XT-A«, ttM2 
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1 Title of Invention 

SYSTEM AND METHOD FOR OPTIMAL ADAPTIVE MATCHING 
OF USERS TOPMOST RELEVANT ENTITY AND INFORMATION 

IN REAL-TIME 

2 Claims 

I A computerized system for associating an observed behavior with 
infonnational items, comprising: 

a converter capable of converting the observed behavior to a behavior 

vector; 

a profile adapter capable of modifying a profile vector with the behavior 
vecton and 

a comparater capable of comparing the modified profile vector to a 
plurality of entity vectors, the entity vectors indicative of the informational items, 
so as to identify at least one entity vector closely associated with the observed 
behavior. 

2 A system for selecting adverdseraents in a computer environment, 
comprising: 

a database of electronic advertisements; and 

an electronic advertisement management system, comprising: 

a converter capable of converting an observed behavior of a user 
computing device in the computer environment to a behavior vector, 

a profile adapter capable of modifying a profile vector indicative of the 
user with the behavior vector, 

a comparater capable of comparing the modified profile vector to a 
pluraUty of entity vectors, the entity vectors indicative of the electronic 
advertisements, so as to identify at least one entity vector closely associated with 
the observed behavior, and 

a selector accessing the electronic database with the identified entity vector 
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so as to select at least one electronic advertisement to communicate to the user 
computing device. 

3 . A computerized system for adapting an entity vector, comprising: 

a converter capable of converting an observed behavior of a \iser into a 
behavior vector; 

a profile adapter capable of modifying a profile vector indicative of the 
user based on the behavior vector; and 

an entity adapter capable of modifying an entity vector indicative of an 
informational item based on the profile vector or the behavior vector, 

4 A system for generating a profile vector in a computer environment, 
comprising: 

a converter capable of converting a plurality of observed behaviors of a 
user into an associated plurality of behavior vectors; and 

a profile adapter capable of repeatedly modifying a profile vector 
indicative of the user based on the plurality of behavior vectors. 

5 A computerized system for adapting an entity vector, comprising: 

a converter capable of converting an observed behavior of a user into a 
behavior vector; and 

an entity adapter capable of modifying an entity vector indicative of an 
informational item based on the behavior vector. 

6 A system for selecting advertisements in a computer environment, 
comprising: 

a database of electronic advertisements; and 

an electronic advertisement management system^ comprising: 

a converter capable of converting an observed behavior of a user 
computing device in the computer environment to a behavior vector, 

a comparater capable of comparing the behavior vector to a plurality of 
entity vectors, the entity vectors indicative of the electronic advertisements, so as 
to identify at least one entity vector closely associated with the observed behavior, 
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and 

a selector accessing the electronic database with the identified entity vector 
so as to select at least one electronic advertisement to communicate to the user 
computing device. 

7. A method of associating an observed behavior with informational items on 
a computer including a data storage, comprising: 

converting an observed behavior to a behavior vector; 
modifying a profile vector with the behavior vector, and 

comparing the modified profile vector to a plurality of entity vectors, the 
entity vectors indicative of the informational items, so as to identify at least one 
entity vector closely associated with the observed behavior. 

8 A method of selecting advertisements in a computer environment, 
comprising: 

providing a database of electronic advertisements; 

converting an observed behavior of a user computing device in the 
computer environment to a behavior vector; 

modifying a profile vector indicative of the user with the behavior vector; 

comparing the modified profile vector to a plurality of entity vectors, the 
entity vectors indicative of the electronic advertisements, so as to identify at least 
one entity vector closely associated with the observed behavior; 

accessing the electronic database with the identified entity vector; and 

selecting at least one electronic advertisement to communicate to the user 
computing device. 

9 A method for adapting an entity vector on a computer including a data 
storage, comprising: 

converting an observed behavior of a user into a behavior vector; 
modifying a profile vector indicative of the user based on the behavior 
vector; and 

modifying an entity vector indicative of an informational item based on the 
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profile vector or the behavior vector. 

10 A method of generating a profile vector in a computer environment on a 
computer including a data storage, comprising; 

converting a plurality of observed behaviors of a user into an associated 
plurality of behavior vectors; and 

repeatedly modifying a profile vector indicative of the user based on the 
plurality of behavior vectors, 

11 A method of adapting an entity vector on a computer including a data 
storage, comprising: 

converting an observed behavior of a user into a behavior vector; and 
modifying an entity vector indicative of an informational iten:i based on the 
behavior vector. 

12 A method of selecting advertisements in a computer including a data 
storage, comprising: 

providing a database of electronic advertisements; 

converting an observed behavior of a user computing device in the 
computer to a behavior vector; 

comparing the behavior vector to a plurality of entity vectors, the entity 
vectors indicative of the electronic advertisements, so as to identify at least one 
entity vector closely associated with the observed behavior; 

accessing the electronic database with the identified entity vector; and 

selecting at least one electronic advertisement to communicate to the user 
computing device. 
3 Detailed Description of Invention 

Background of the Invention 

Field of Invention 

The invention relates to associating entities and information with behavior. 
More particularly, the invention relates to a system and a process for targeting and 
delivering advertising, coupons, products, or infomiational content to users based upon 
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observed behavior. 

Description of the Related Technology 

The widespread availability of the World Wide Web (web) and Internet services 
has resulted in a unique set of advertising opportunities. Unlike conventional 
"broadcast" media, such as television and radio, the web is a "narrowcast" medium that 
allows the user to have higher levels of control over the information they receive. Since 
users can control the retrieval of infontxation, the advertising techniques utilized in the 
conventional broadcast model hzis become less effective and can alienate potential 
customers as a result of the "shotgim" effect The potential of selectively targeting 
advertisements on a user-by-user basis has been unrealized due to the difficulty in 
performing meaningful targeting of cxistomers. The current generation of web ad 
selection engines utilize a number of partially successful techniques to target customers. 
Typically, the effectiveness of these techniques is measured in terms of audience 
response rates. Audience response, also called "cUckthrough", is evaluated by counting 
the number of users that click on a "baimer advertisement" contained on a web page 
which is presented to the user. Clicking on the banner advertisement typically takes the 
user to the web site of the advertiser where additional information about a product or 
service is provided. In the current Internet advertising environment, clickthrough is the 
best measure of the effectiveness of advertising techniques. Consequently, the value of 
advertising is directly related to the effectiveness of the ad. Therefore, the 
maximization of clickthrough is of paramount importance for most web sites for both 
practical and financial reasons. 

Some current banner advertising selection techniques are listed in the tables 
below. These techniques are divided into two classes. The first class of advertising 
selection techniques, shown in Table I, use simplistic first generation techniques that 
are based only on static a priori information. The second class of advertising selection 
techniques, shown in Table 2, utilizes some of the techniques used in the more 
sophisticated second generation ad selection systems which may take into account some 
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measure of user behavior, such as a user query, or make use of predisclosed user 
preferences. However, these more sophisticated objectives often only complicate the 
problem. In Table 1 and Table 2 certain disadvantages of each method are given, 
however, the Tables are not meant to be all inclusive so not all disadvantages may be 
shown. 

Table 1, First Generation Ad Targeting Techniques. 



Method 


Disadvantage 


Domain name of user browser 


• Provides no significant user insight; Does not 
account for user behavior 

• Implies user behavior is related to usage domain 

• Provides poor clickthrough 


Browser type 


• Implies user behavior is related to usage browser 
type/version 

♦ Provides poor clickthrough 


System type 


• Implies user behavior is related to system type 

• Provides poor clickthrough 


Service provider 


• Implies user behavior is related to usage domain 

• Provides poor clickthrough 


Geography/location 


• Requires up-to-date knowledge base of IP address 
versus location 

• Provides poor clickthrough 

• Provides no significant user insight 


Site SIC Code 


• Requires up-to-date knowledge base of SIC code 
versus IP address 

» Provides somewhat improved user clickthrough 

• Provides no significant user insight 


Company size 


• Requires up-to-date knowledge base of SIC code 
versus IP address 

• Provides no significant user insight 

• Implies user behavior is related to size of company 





• Provides poor clickthrough 


Knowledge base techniques 


• Requires maintenance of knowledge base 

• Costly to maintain 

• Cannot incorporate observed user behavior 
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Table 2. Second Generation Ad Targeting Techniques. 



Method 


a uv an lag e 


User registration information 


• Requires user willingness to disclose information 

• Requires many judgments on products for 
ettective operation 

• Requires a substantial preexisting judgment 
database 


Search key words 


• Misses ads that are conceptually close but do not 
contain key word 

• Restricts available inventory 

• Requires careful choice of key terms 


Hand targeting of ads to sites 
or pages 


♦ Very labor intensive; does not scale well 

• Humans not good at manual targeting for large 
numbers of ads 


Hand analysis of site or 
locations in a site 


• Very labor intensive; docs not scale well 

• Humans not good at manual analysis of large 
numbers of sites 


Random presentation 


• PcM3r response rates 

• Alienates users 


Date/time 


• Poor response rates 


Hand analyzed sites 


• Very labor intensive 

• High cost 



In the current web environment, users utilize search services to find relevant or 
interesting information. These search services provide a potential focus for the 
identification of user behavior as defined by the searches they execute, the web pages 
they view and positions in the directory hierarchy they visit. However, existing banner 
advertising selection techniques fail to analyze this behavior when selecting an 
advertisement. These search services provide an opportunity for presentation of user 
specific advertising. 

The conventional techniques shown in Table 1 and Table 2, use hand coded 
associations and lists to perform customer "targeting." Certain techniques may use only 
the current user query as part of ad targeting. Each of the methods shown in Tables 1 





(42) 



2000-20555" 



P - 6 1 6 8 F 



- 8 



and 2 may be associated with five general categories of advertisement selection 
techniques. These categories include: 

(i) rule-based categorization; 

(ii) keyword based ad selection; 

(iii) assigning ads to individual web pages or sites; 

(iv) assigning ads to branches in hierarchical organizations of pages; and 

(v) collaborative filtering. 

A description of each category is provided below, 

Rule Based Ad Selection 

Rule based ad selection uses available information and rules to select an 
appropriate ad. This technique can be effective if large numbers of rules are manually 
coded and the rule developer has a deep understanding of the problem domain. 
However, one problem with this system is that human intellectual effort is required to 
write or maintain the rules. The development of a rule base may be very expensive and 
time consuming. 

Additionally, the rules for advertisement selection are limited to available 
variables with discrete values and provide "brittle" decision boundaries. These decision 
botmdaries are typically binary and are frequently mishandled. 

Rule based ad selection requires extensive knowledge about the targeted 
operating domsdn. Even with computer-aided tools, a knowledge engineer is reqmred to 
develop the rules £ind administer the system. Furthermore, humans have demonstrated 
time and again, that they are poor at encoding rules. This observation is particularly 
true when large numbers of variables are encompassed within the scope of the problem 
being modeled. 



Keyword BsLsed Ad Selection 

In keyword based ad selection systems, the ads are selected on the beisis of one 
or more user provided words. When an observed user behavior (typically a user issued 
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query) contains a known keyword, one of the ads, which is manually associated with the 
keyword, is selected for display. . This technique provides good response rates for the 
keywords chosen. However, a major drawback with this approach is the system 
administrator must manually choose the keywords associated with each ad. This 
technique, based on intellectual effort and deep knowledge of the ad-specific domain, is 
time consuming and error prone. Additionally, the "inventory'' of keywords at a site 
quickly becomes sold out Lastly, with keyword based ad selection techniques, the ad 
selection process does not account for previous user behavior. The ad selector only uses 
a set of human-selected keywords in the current inventory based upon the current search 
query. Synonyms of user provided words are not automatically targeted without a 
thesaurus or synonym list. 

Assiening Ads To Individual Pages 

Ads are sometimes manually targeted to individual web pages. This method 
requires human intellectual effort to match an advertisement to a web page. However, 
such effort is usually prohibitive in large scale sites containing thousands of web pages. 

Assigning Ads to Branches with Hierarchies of Pages 

Ads are sometimes manually targeted to hierarchies or categorizations of pages 
called page ontologies. This technique may provide effective performance if the human 
making the assignment of the ad to a branch of the hierarchy has a good feel for the 
content of the site and understanding of the intended viewer. However, htiman 
intellectual effort is required to select the appropriate branch or category for the ad. 

Assigning Ads To Web Sites 

Ads are sometimes manually targeted to all of the pages in a web site. 
However, as was seen with many of the other systems, human intellectual effort is 
required to select the appropriate ad for the web site. This method is inflexible in that 
an advertiser cannot automatically target an ad to the best pages within a site. 



(44) 0 0 0-2 0 5 5 5" 

P - 6 1 6 8 F - 10 - 

Typically, advertisers want to display different ads for each page in a site. Another 
problem with assigning ads to web sites is that the ads served to the user are not context 
dependent in that they fail to utilize user specific information. 

Collabor ative Filtering Techn^i^ iK^g 

Collaborative filtering (CF) techniques have been proposed for the problem of 
selectively targeting specific ads to web users. The CF approach requires large numbers 
of users to formally register with the system and make preference judgments about the 
quality of the ads. coupons and information content they receive. Under certain limited 
circumstances, this technique may provide some degree of effective matching in small 
scale tests. However, for large tasks, such as found on the Internet, the algorithms 
become both computationally intractable and impractical. Additionally, the CF 
techniques perform best when the universe of entities are static rather than time 
evolving. In the Internet market, static content is the exception, not the norm. 
Furthermore, the utHity of the CF approach is directly related to the numbers of users 
that have made preference judgments. Typically, users arc reticent to spend a 
substantial amount of effort which is required to make these judgments both because of 
personal time limitations and concerns about privacy. As such, data acquisition 
becomes a major problem for the advertiser. 

CF solutions typically require a knowledge engineer to implement a system of 
sparse vectors of a very high dimension, where the dimension of the problem space is 
equal to the number of entities under corisideration. However, this solution has been 
found to be computationally intractable. Another problem with CF techniques is that 
the ad selection software is examining for orthogonal relationships which requires a 
substantial number of statistically compUcated steps. The ad selection sofbvarc must 
fmd close neighbors in the vector space and suggesting coordinates not in common 
between the neighbors. 

The existing ad selection systems, particularly in coupon and prim media 
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advertising, fail to address the interactive nature of the Internet and electronic 
commerce. Advertisers need to be able to identify users of specific interests, track those 
interests over time and disseminate, in a highly selective way, information, advertising, 
coupons and product offerings that will be of interest to the user. Additionally, 
advertisers need to track user interests and behavior in a real-time manner. 

Therefore, advertisers need a system which is sensitive to user behavior for 
targeting advertising, coupons, products and information content. This system should 
enable the targeted marketing in real-time and to a granularity of an individual user as 
well as groups of users that have similar behavioral characteristics. 

Summary of the Invention 

The present invention includes a system and method for delivering targeted 
entities, such as advertising, coupons, products and information content to useris based 
on tracking observed behavior. The system model is an ad^tive vector space 
representation for entities, information and behavior. The system matches users to 
entities in a manner that improves with increased operation and observation of user 
behavior. 

The present invention uses an informational representation called entity or 
content vectors. The content vectors are a high dimensional, real vector representation 
that encodes contextual similarity. The system utilizes a constrained self-organization 
learning algorithm to learn the relationships between symbols which are typically words 
in unstructured text. This learning algorithm discovers relationships between words or 
symbols from a set of training examples for a domain of interest and assigns a tmique 
content vector to each symbol. The resulting representation is such that symbols that 
appear in a similar context will possess content vectors that point in similar directions in 
this high dimensional content vector space. 

Web pages, banner advertisements, coupons, and any other textual or symbolic 
information, are represented as a summary content vector by forming the normalized 
weighted vector sum of the content vectors of the words (symbols) in the page or 
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description of the product or service. These summary content vectors have the property 
that pages that discuss similar information have summary content vectors that point in 
similar directions. 

The actions of each user are represented by profile vectors. Typical user actions 
include, but are not limited to: issuing queries requesting or reading pages, visiting 
Internet sites, responding to ads, and redeeming coupons and purchasing products. A 
user's profile vector is configured to track observed behavior by using the content 
vector representation of the associated actions. For example, when the user requests a 

page of information, the user's profile vector is adjusted based upon the entity vector of 

the requested page. 

The user profile vector is utilized as the mechanism for selecting the best entity 
(e.g., ad, coupon, product or information) to present to the user The user profile vector 
is compared to each active entity vector, and the closest entity content vector is selected 
for display to the user. 

The present system also performs the optimal adaptive positioning of entity 
vectors. If a user is presented a banner ad and requests more information by clicking the 
mouse on it, the entity vector for the ad is adjusted using the user's profile vector. 
Additionally, the user profile vector is adjusted using the ad content vector. This 
mutual adaptation allows optimum positioning of ads relative to users. 

In this system, the user profile vectors evolve through a user's usage of the 
system. Clustering and classification techniques are applied to the adapted profile 
vector set to discover behavior patterns that are utilized for focused marketing 
campaigns. 

Likewise, ad and coupon entity vectors evolve as a result of user behavior. 
These evolved vectors encode summary characteristics of the users who clicked on the 
ad or redeemed the coupon. These summary characteristics are used to modify product 
positioning and discover the characteristics of the users who are interested in the 
product or service. 

The system is fully automated and does not require any rules for operation and is 
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based on self organizing neural network techniques. Additionally, the system operates 
using tacit user observation and does not require explicit user judgments for correct 
operation. 

Detailed Description of the Preferred Embodiments 

The following presents a detailed description of certain specific embodiments of 
the present invention. However, the invention can be embodied in a multitude of different 
ways as defined and covered by the claims. In this description, reference is made to the 
drawings wherein like parts are designated with like numerals throughout 

Figiu-e 1 is a block diagram illustrating a computer environment associated with 
the present invention, A client computer 100 has a monitor 102 and a processing unit 
103. The processing unit 103 includes a data storage. 

The client computer 100 stores information that may be exported to other 
computing devices through a network 104. The network 104 may include any type of 
electronically connected group of computers including, for instance, the following 
networks: Internet, Intranet, Local Area Networks (LAN) or Wide Area Networks 
(WAN). In addition, the connectivity to the network may be, for example, remote 
modem, Ethernet (IEEE 802.3), Token Ring QEEE 802.5), Fiber Distributed Datalink 
Interface (FDDI) or Asynchronous Transfer Mode (ATM). Note that computing devices 
may be desktop, server, portable, hand-held, set-top, or any other desired type of 
configuration. 

When a remote user requests information from the network 104, the client 
computer 100 displays an advertisement with the requested information. Based on a 
request firom the client computer 100, a, server 106 may select an appropriate 
advertisement to display to the user based upon the user's observed behavior. 

In one implementation, the server 106 includes a gateway which is connected to a 
WAN 108. The WAN 108 has a plurality of network servers 1 10. One of the network 
servers 1 10 is connected to a LAN 1 12 comprising a plurality of computers 1 14. The 
system software that selects the advertisement may be located on one the network servers 
110 or another computer in the network 104. In one embodiment of the invention, the 
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advertisement selection software executes in part on a plurality of the network servers 1 10, 
In another embodiment of the invention, the advertisement selection software executes on 
a plurality of the computers 1 14 on the LAN 112. In yet another embodiment of the 
invention, the advertisement selection software resides on the client computer 100. It is 
important to understand that the advertisement selection system of the present invention 
may be hosted on any computing device so long as a communication pathway exists 
between the advertisement selection software and the requester of the advertisement 

Figure 2 is a functional block diagram illustrating the processing and data 
components of the present invention. The following description focuses on the system*s 
ability to deliver advertising, specifically banner advertising over the Internet. 
However, -the techniques utilized in this invention are general in nature and can be 
applied to any type of entity or information. Furthermore, the network environment 
need not be the Internet as indicated previously. 

The present invention employs vector modeling of information so as to identify 
relationships among the informational items or entity vectors. A process for making 
and using entity vectors is described in the U.S. Patent No. 5,619,709 filed November 
21, 1995, entitled "SYSTEM AND METHOD OF CONTEXT VECTOR 
GENERATION AND RETRIEVAL" to Caid, et al. 

This enrity vector generation scheme is designed to produce content vectors. In 
an application to words, for instance, the scheme generates one vector per word, which 
represents the relative proximity of a meaning or content among words or documents in 
a quantitative and geometric manner. The system then creates an entity vector based 
upon the words in the entit>- and their associated word content vectors. Thus 
informational items having similar meanings have closely aligned vectors, while 
informational items having dissimilar meanings have approximately orthogonal vectors. 

In the foUowing description, the words "content vectors" and "entity vectors" 
are used synonomously. Both terms refer to a vector that is associated with certain 
content information, ad, coupon, solicitation, or product, for instance. 

The following description is divided into the sections: (I) System Component 
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Overview, (2) Word Content Vector Learning Module, (3) Session Compiler Module, 
(4) Real-Time Ad Server Module, (5) Profile Vector Update Server Module, (6) Entity 
Vector Update Server Module, (7) Profile and Entity Adaptation Algorithms, (8) 
Calculation of Entity Inventory Weighting (Cost Model), and (9) Relationship 
Discovery and Analysis Processing Module. 

System Component Overview 

Beginning the discussion by reference to the bottom of Figure 2, a word content 
vector learning module 200 creates a set of word content vectors from a domain relevant 
training corpus 202, a stop list file 204, and a phrase list file 206. The stop list file 204 
contains a List of words, word fragments and phrases for the word content vector 
learning module 200 to ignore. The phrase list file 206 is a list of words that the word 
content vector learning module 200 groups together. The training corpus 202 is the set 
of informational objects used to train the word vectors. The functions of the training 
corpus 202, the stop list file 204, and the phrase list file 206 are further described below. 

When the word content learning process is complete, there is one word content 
vector in a word vector database 208 for each word in the training corpus 202 that is not 
in the stop list 204. These word content vectors have the property that words that are 
used in a similar context have content vectors that point in similar directions in the high 
dimensional content vector space. The word content vectors serve as the basis for the 
ad selection operations performed by the present system during its operation. The word 
content vector learning process is performed once as part of the initialization process. 
However, these vectors can be updated if desired. Normally, the word content vectors 
are static during normal operation of the invention, since the meaning of words in the 
English language evolves slowly over time. 

A session compiler module 210 takes a set of session control information, in the 
form of structured text from a session description database 212, and transforms the text 
into control commands for a real-time ad server (RTAS) module 214 in a session 
control file 215. Typical information processed during the compilation process includes 
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the number of active ads, the number of allowable impressions for each ad, start and 
stop times, and dates for showing each ad. The session compiler module 212 may be 
omitted from the system if such functionality is not needed. 

The present invention then computes an initial entity vector for each ad or entity 
in the system. In most cases, this entity vector is based on a textual description of the 
entity which is located in an entity description database 216. For instance, if the entity 
is an ad for a car, the words in the advertisement are used to determine the entity vector. 
The entity vector is computed as a normalized weighted sum of the word content 
vectors that are in the advertisement. A textual description of any item can be used as 
the initial condition for the entity vector. Since entity vectors can evolve during system 
operation, the initial condition of the entity vector can be null, and no textual 
description of the entity is required for system operation. However, in normal 
operation, this evolution may require substantial time if system usage rate is low and as 
a consequence, the preferred embodiment would start wdth any reasonable text 
description as an initial condition. 

In the present invention, more ads can be sold in a thematic region of interest 
than in previous systems since all ads are selected on the basis of vector comparisons 
and not exact matches, thus increasing the available inventory. For example, the 
provider of the present invention could sell an ad slot based upon the regions of the 
vector hyperspace close to the words in the ad and not just a selected set of words. 

The entity vector approach also allows administrators to effectively seuip ad 
definitions vdthout special skills or domain knowledge, thus improving overall system 
performance wthout the requirement for domain experts. The present invention 
automatically targets an ad to the best pages within a site, not just the site as a whole. 
As a consequence of this feature, different ads may be associated with the same page at 
a site. In addition, the present invention automatically selects the most relevant pages 
within a hierarchy or category for a particular ad. Alternatively, the system can be 
configured to serve the best ad independent of any ontology that might be present and 
based upon only on matching to observed user behavior. 
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In the present invention, the ads served to the user are context dependent in that 
they depend on both the contents of the page, the current user action and the historical 
user profile. The entity vector approach provides a solution which is compact and 
adaptive. The entity vector representation requires a much smaller amount of data for 
training as compared to the collaborative filtering approaches. Additionally, the 
multidimensional entity vector representation of the present system leads to superior 
generalization capabilities as compared to the collaborative filtering approaches. 

Referring again to Figure 2, the real-time ad server (RTAS) module 214 is the 
engine which observes the user behavior, and based upon that behavior, selects the 
appropriate ad to present to the user computer 219 located at the top of the figure. The 
RTAS module 214 uses the current user action, the user's profile vector and the active 
set of entity vectors in selecting the appropriate advertisement. The RTAS module 214 
uses vector proximity calculations such as inner product to determine the optimal ad to 
display to the user. However, other distance metrics may also be employed. 

If the RTAS module 214 detects that a user has performed an "adaptation event" 
on the client computer 219 such as issuing a query .217^ requesting a page 218, 
purchasing a product or chcking on an ad 222, the RTAS module 214 sends an update 
message to the a profile update server (PVUS) module 224 or an entity update server 
(EVUS) module 228. The RTAS module 214 utilizes a static content vector database 
234 and a high speed file 232 to hold working values of the entity or ad vectors. Upon 
the selection of the proper entity, the RTAS module 214 sends the selected ad to the 
client computer 219. 

The PVUS module 224 adapts the user profile vectors in response to a request 
from the RTAS module 214. A profile vector for each user is stored in a profile vector 
database 226. This adaptation process moves the user profile vector in the direction of 
the entity vector associated with the adaptation event. For instance, if the user clicks on 
an ad, the user profile vector is moved a small step in the direction of the entity vector 
for the ad. 

The EVUS module 228 performs a nearly identical action as the PVUS module 
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224, but perfonns the operation on the entity vectors for advertisements. Each entity 
vector is stored in an entity vector database 230. For example, if the user clicks on an 
ad, the entity vector for the user selected ad is moved a small step in the direction of the 
user's profile vector. 

A relationship discovery and analysis (RD A), module 236 performs processing 
actions on the contents of both the profile vector database 226 and the entity vector 
database 230 to identify useful patterns and trends. The RDA module 236 utilizes both 
clustering of the entity vectors and profile vectors to identify useful behavior patterns. 

It should be noted that the adaptation of the entity vectors is not required for 
system operation. Indeed, when adaptation is enabled, it allows the entity vector of the 
product to "drift" toward users who have received the ad. In some applications, 
information content delivery systems in particular, this drift is not desirable. Clearly, 
the information content of a news story is deterministic and should not change based on 
who reads the story. As such, the present invention has provisions to disable the 
adaptation of entity vectors. However, in many applications, such as Internet 
advertising, the drift of the vectors is the mechanism whereby the system discovers 
patterns and trends. 

In the preferred embodiment described herein, the software programs are written 

in the C, C-hh and TCL programming language and nm under the well-known UNIX 

operating system. C, C-h-^ and TCL are industry standard programming languages for 

which many commercial compilers can be used to create executable code. However, the 

present invention may be run on a variety of conventional hardware and software 

platforms. The software system described herein may be distributed across different 

subsystems running on different hardware platforms. The components may 

communicate using messages transmitted using any network protocol, such as 

Transmission Control Protocol/Internet Protocol (TCP/IP) and RCP. The specific 

platform that hosts these modules and files is unimportant to the invention provided that 

the host computing environment has sufficient processing power. Additionally, each 
processing and/or data component may be hosted on a separate platform as long as paths 





(53) 



#M2 000-20555 



• P - 6 1 6 8 F 



- 19 



of connectivity are provided via any sufficiently robust communication protocol. 

The present Invention includes six principle processing modules as follows: the 
word content vector learning module 200, the session compiler module 210, the real- 
time ad server module 214, the entity vector update server module 228, the profile 
vector update server module 224, and the relationship discovery and analysis module 
236. Below, the aforementioned components are described in further detail. 

Word Content Vector Learning Module 

The word content vector learning module 200 (shown in Figure 2) is 
implemented as an application programming interface. The application programming 
interface may be part of a computer program library. Advertisers use the procedures 
provided by this library to create a stand alone executable computer program capable of 
ruiming on any platform of sufficient processing power. This program performs the 
content vector learning process which in one embodiment, is further described in the 
Caid patent. Additionally, this program writes the output of entity vector learning into 
data structures which are then utilized by the session compiler module 210 to create 
files optimized for runtime efficiency. 

The training corpus 202 which includes a large number of documents containing 
unstructured text or symbols is selected and processed through the content vector 
learning algorithm. The resulting objects produced through the content vector learning 
process are then adapted for use by the other system components. 

Figure 3 is a block diagram illustrating the inputs and outputs of a pre- 
processing module 300 of the word content learning module 200 shown in Figure 2. As 
part of the pre-processing the word content vector learning performs the following 



Referring to Figure 3, the requisite input files for the word content vector 
learning module 200 are assembled. The three input files are the training corpus 202, 
the stop list file 204 and the phrase list file 206. 



functions: 



Forms input. 
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In the situation where the symbols of interest are a series of words 301, the 
training corpus 202 includes a set of unstructured free form text documents that cover 
the domain of interest. For example, if the domain of interest is outdoor sports such as 
hunting or fishing, an appropriate training corpus might be 3 years of articles from Field 
and Stream magazine and the outdoor section of the local newspaper. This text is 
typically a "flaf ASCII format with any typesetting or formiatting information removed. 

The stop list file 204 (shown in Figure 2 and 3) is developed through a 
combination of human intellectual effort and conventional statistical techniques, that 
contains a list of words, word fragments and phrases for the word content vector 
learning module 200 to ignore. For the content vector word learning, as with 
conventional statistical information retrieval techniques, many words are meaningless. 
For instance, "AND", "NOT". "BUT", and "THE^' are words that convey little meaning 
in terms of determining the thematic content of a set of text. As a consequence, these 
terms should be ignored. The stop list file 204 is a flat ASCII file that contains' an 
exhaustive and enumerated list of words to ignore with one entry per line. The typical 
length of this file for conventional applications is approximately 250-350 of the 
statistically most frequently occurring words in the training corpus 202. 

The phrase list file 206 (shown in Figures 2 and 3) contains the list of word 
sequences that are to be treated as a single symbol. Using this file, the word content 
vector learning module 200 treats certain phrases as single symbols. For instance, *'San 
Diego" should be considered as a single symbol. The contents of the phrase list 206 are 
determined through intellectual effort, statistical techniques, linguistic processing or any 
combination thereof The phrase list file 206 is not required for correct operation of the 
word content vector learning module 200, but the use of a meaningful phrase list does 
improve system perfonnance. The phrase list 206 is a flat ASCD file with one phrase 
per line in the file. 

2. Performs word content vector learning. 

Once the training corpus 202, stop list file 204 and phase list file 206 have been 
assembled, the word content vector learning process is performed. The Caid patent 
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provides a full disclosure on this approach, but a summary of the key steps are repeated 
here for convenience. 

Referring to Figure 3, the preprocessing is performed by a preprocessing module 
300 which is part of the word content vector learning module 200. The preprocessing 
module 300 reads the training corpus 202, determines if the current word is on the 
phrase list file 206 or the stop list file 204, performs the stemming of the word, and 
writes a resulting valid stem 302 to an intermediate stem file 304 (shown in Figure 3). 
The stemming process removes common suffixes from each of the words in the training 
corpus 202. 

Figure 4 is a block diagram illustrating the inputs and outputs of the process for 
creating a stem hash table 400. The stem hash table 400 is created by a stem hash table 
creation module 402. The stem hash table creation module 402 is a sub-component of 
the word content vector learning module 200. For all of the stems 302 in the 
intermediate file 304, data items 404 are made in a stem hash table 400, This hash table 
also contains pointers for each stem to a unique data element that consists of a stem text 
string, stem statistics, a stem content vector, and a correction content vector that is used 
as temporary storage to accumulate the change vector to be applied to the stem content 
vector as part of the learning process. 

Figure 5 is a block diagram illustrating the random nimiber generating process 
for creating initial conditions for the stem vectors. The initial conditions for each stem 
data item in the stem hash table 400 is created by a unifonm pseudorandom number 
generator (UPNG) module 500. The UPNG module 500 generates an initial random 
content vector and stores this vector in the stem content vector. The UPNG module 500 
generates initial conditions for stem vectors through the use of a long period 
pseudorandom number generator which creates a flat distribution random number 502. 
Any random number generator can be used assuming the period of repetition is 
sufficiently long (more than 100,000,000 cycles). Using the flat distribution random 
number 502, a transformer module 504, creates a Gaussian random variate 506 that has 
the property of zero mean and unit variance. An installation module 508 assigns the 
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first Gaussian random variate to the first element of the current stem content vector. A 

second random variate is then assigned to the second element of the stem content 

vector. This process of assigning unique Gaussian distributed random numbers is 
repeated until all elements of all stem content vectors of all the stems in the stem hash 

table 400 have been populated. 

Figure 6 is a block diagram illustrating the stem frequency statistics calculation 
process of the content vector learning module shown in Figure 2. A processing module 
600 acquires the stem frequency statistics from the intermediate stem file 304, The 
processing module 600 is a sub-component of the word content vector learning module 
200. The processing module 600 reads the intermediate stem file 304 and computes the 
number of occurrences of each stem 302 in each document in the intermediate stem file 
304. The processing module 600 then stores these statistics in the stem statistic section 
of each data item 404 in the stem hash table 400. 

Figure 7 is a diagram of the different learning convolutional windows of the 
entity selection system shown in Figure 2. A series of corrections to the initial 
conditions of the stem content vectors based on word co-occurrences arc computed for 
each of the stem content vectors in the stem hash table 400. The present system 
modifies the stem content vectors based on the words that co-occur with a stem using a 
convolutional co-occurrence window. Figure 7 shows an initial source text 700. After 
some preprocessing, the source text 700 is transformed into the preprocessed text 702. 
The system creates a convolutional window 704 to analyze a center stem and the center 
sterna's neighbors. The window has a center and up to three words on either side of the 
center, thus providing seven total words in the window. As can be seen in Figure 7, the 
center of the window 704 is at the front of the document. As such, the window is one- 
sided. The correction vector for the window 704, centered on the stem "mao", consists 
of a vector function of the initial condition content vectors for *'rebel", "group", and the 
phrase "Sendero Luminoso." The correction vector for a window 706, centered on stem 
"rebel", consists of a vector function of the initial condition content vectors for "mao", 
"group'*, "Sendero Luminoso" and *'bomb." The window is moved one stem at a time 
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and this process is continued for each stem in the preproccssed text 702. At each update 
position, a correction vector is calculated and summed into an accumulated correction 
vector located in the data items 404 of the stem hash table 400 (shown in Figure 4). 

Figure 8 is a diagram illustrating a manipulation process for calculating a stem 
vector by the vectors of its neighboring stems. Each stem in the stem hash table 400 is 
modified by the vector of its neighboring stems. For each convolutional window, a 
vector 800 associated with the center stem is adapted by a vector 802, 804, and 806 
which are associated with the stems of the center stem's closest neighbors. 

The following equations 1-4 provide the method for calculating the correction 
for each word in the convolutional window shown in Figure 7, 

Eij'^Nij^Tj (1) 
The value Ey represents the error or correction between the current target 
(center) Tj and neighbor Nij. A correction for Tj taking into account all current 
neighbors in window position is shown by equations 2 and 3 
ws 

c~=i:(Kil-«.)4 (2) 

p CURRENT _ ^ ACCtJMULATBO , r'^URRENT . 

^^J '^^j (3) 

The variables shown in equations 2 and 3 are defmed as follows: 

(i) i = summation d\muiiy variable; 

(ii) QcvRREin- ^ correction vector for stem j ; 

(iii) QAccvh^uLATEo ^ J^J^J^J^^g summed correction for stem j stored in stem 
hash table data elements; 

(iv) WS = window size in stems; and 

(v) a.j = a proximity constraint that limits the correcting effect according 
to the statistics of stem i and j where a-j = I - Q^Qj , 



0. = 5 + (l-S) 
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Equation 4 is used to calculate the variable a^^ for equation 3. The variables 

shown in equation 4 are defined as follows: 

(i) = statistical importance of stem i in the training corpus; 

(ii) B = bounds control parameter determined empirically; 

(iii) NDi = number of documents that contain stem i; and 

(iv) TND = total number of documents in the training corpus. 

Equations 5-9 included below provide a final update to the vectors. It should be 
noted that the algorithm described in the Caid patent utilizes a batched update process. 
As such, the algorithm accumulates corrections to the target (center) stem content 
vector. These corrections are made only at the end of a pass through the training corpus 
202. Typically, only two passes are required to achieve excellent learning results. The 
equations 1-4 are applied for each window position and the results are accumulated At 
the end of each pass through all the stems in the intermediate stem file 304, the 
equations 5-9 are applied. The algorithm disclosed in the equations 5-9 computes the 
mean stem content vector, subtracts this from each normalized stem content vector and 
then re-normalizes the entire set of stem content vectors. This computation prevents the 
stem content vectors from being localized to only one region of the hypersphere and 
promotes better utilization of the vector space. 
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The variables used in the equations 5 through 9 are defined as follows: 

(i) r/^^ = old target content vector (initial condition or previous pass); 



(ii) 




= updated target content vector for current pass; 



(V) 



(iii) 
(iv) 



Y= learning rate; 

Fj - total number of instances of stem j in the training corpus; 
QACcuhojiATED ^ accumuIatcd correction vector for stem i for this pass; 



(vi) M = mean stem vector; and 

(vii) NSTEMS = total number of unique stems in the training corpus. 

3 . Writes output file. 

Once the training is complete, the resulting stem content vectors are written to 
the word vector database 208. 

Session Compiler Module 

Figure 9 is a block diagram illustrating the inputs and outputs of the entity 
vector creation process of the session compiler module 210. In the present invention, 
the session compiler module 210 performs three functions: text to entity vector 
transformations, file format conversions, and session control file generation. Each of 
these functions is described below. 

1 . Text to entity vector transformations. 

To enable the selection of data or information, a text to entity vector 
representation transformation is required to generate the entity vectors. Figure 9 
illustrates the processing performed by the session compiler module 210 when it 
converts textual information into an entity vector. A preprocessing module 1 100 reads 
the entity descriptions fix>m the entity description database 216. The preprocessing 
module 1 100 is a sub-component of the session compiler module 210 shown in Figure 

2. The preprocessing module 1 100 module is similar to the preprocessing performed as 
part of the preprocessing module 300 shown in Figure 3. The preprocessing module 
1 100 determines if the current word read from the entity descriptions database 216 is on 
the stop list file 204 or on the phrase list file 206. The valid stems 302 are then used by 
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an eatity vector formation module 1 102 to generate static entity vectors which are then 
stored in the static content vector database 234. 



module 210 shown in Figure 2 to form entity vectors. The content vector for an entity 
is the normaUzed weighted sum of the symbols that comprise that entity. For those 
entities that are textual descriptions, the description vector is the normalized weighted 
sum of the stem content vectors of the stems in the description. 



The variables in equation 10 are defined: 

(i) ECVj = the entity content vector for entity i; 

(ii) SC - the stem content vector for stem j ; 

(iii) TND = the total number of documents in the training corpus; 

(iv) NDj the number of documents in the training corpus that contain stem 
j; and 

(v) NSTEMS; - the number of stems in the description of entity i. 

2. File format conversions. 

Figure 10a is a block diagram illustrating the process for creating the high speed 
files 232 shown in Figure 2. The session compiler module 210 performs the file format 
conversions to facilitate the entity selection process, since the data structure formats that 
are computationally efficient during word content vector learning are inappropriate for 
use by the RTAS module 214 during entity selection. The operational flexibility and 
complexity required for the word content vector learning process is not required by the 
RTAS module 214, so substantial simplifications are made. As part of this 
transformation, ail of the stem content vectors are pre-scaled by their frequency of 



Equation 10 is an example of the process performed by the session compiler 



ECV. 
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occurrence in the training corpus 202. The stem content vectors are scaled by the same 
factor shown in equation 10 without the final normalization step. Additionally, the low 
frequency stems (those that occur less than four times in the training corpus) are 
removed from the file. The remaining stems represent the statistically most significant 
portion of the overall stem population. The session compiler module 210 then writes 
the resulting truncated and pre-scaled stem content vectors to the high speed files 232. 
3. Session control file generation. 

Figure 10b is a block diagram illustrating the process for generating the session 
control file 215, The primary function of the session compiler module 210 is the 
generation of a session control file 215 fix^m operator created session descriptions 
contained in the session description file 212. The session control file 215 contains the 
instructions in machine readable format to guide the RTAS module 214 during the ad 
selection process. The session control file 215 contains the information specified in the 
session description file 212 and a set of initial entity vectors. The session control file 
2 1 5 has the ability to identify a group of ads eligible for selection and to provide a set of 
backup entity vectors in event the EVUS module 228 is not operational. The session 
information in the session description file 212 describes a set of entities, such as 
advertisements, that are eligible for selection to become active. The session control file 
215 contains a control mechanism for the following attributes for each ad: 

• Static or dynamic attribute control. An ad is either statically set to a fixed location 
in the context vector space or allowed to dynamically adapt based upon user 
responses. 

• Reset. If reset functionality is specified, the entity vector for an existing ad is reset 
to its initial vector. 

• Targeted impression count. The targeted impression count determines the number 
of impressions that should be delivered for the ad. 

• Start date. The start date determines the date and time that the ad is to become 
ehgible for selection. 

• End date. The end date determines the date and time that the ad is to become 
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ineligible for selection. 
• Initial conditions. The advertiser can describe the initial entity vector selection for 
the ad. Options for the initial vector selection include: 

(i) a vector bsised upon the ad and the aforementioned text to vector 
conversion process; 

(ii) a vector based upon the entity vector of a specified ad; and 

(iii) a vector based upon an entity vector contained in an external file. 

The session compiler module 210 also establishes a connection with the EVUS 
module 228 (shown in Figure 2) which is the repository for all active entity information. 
The initial entity vectors are calculated for the ads and the ad identifiers, parameters, 
and vectors are transmitted to the EVUS module 225 for storage in the entity vector 
database 230. 

Real Time Ad Server Module 

The RTAS module 214 provides an Application Programming for Interface 
(API) local or remote software applications call to perform various ad management 
routines! The RTAS module 214 selects according to guidelines set in the session 
control file 215 an advertisement to be displayed to a user. 

During the ad selection processing, the RTAS module 214 performs the 
processing steps listed below. 

1 . Initialization. 

When the RTAS module 214 receives an initiaUzation command, the RTAS 
module 214 reads the session control fde 215 and initializes internal control tables 
stored in memory. The RTAS module 214 then requests the appropriate entity content 
vectors as specified by the contents of the session control file 215, The RTAS module 
214 requests from the entity vector database 230 via the EVUS module 228 the entity 
vectors for the active entities and stores them in a memory resident data structure within 
the RTAS module 214. Once initialization is complete, the RTAS module 214 is ready 
for real-time operation. 

2. Determination of user behavior vector. 
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When a user action message enters the system via the client API, the RTAS 
module 214 establishes the behavior vector for that user. If the user is already known to 
the system, the user id, provided by the user's web browser, is used as the key for a 
database retrieval. The RTAS module 214 passes the user ID to the PVUS module 224. 
The PVUS module 224 then returns the profile vector associated with that user from the 
profile vector database 226. If the user is urJcnown to the system, a new initialized 
vector is returned. In either case, the RTAS module 214 has a valid user behavior 
vector for subsequent operations. This vector is stored within internal memory tables 
within the RTAS module 214. 
3 . Observation of user behavior. 

The RTAS module 214 also incorporates user behavior into the userVs profile 
vector. These behaviors include a web page request 21 8 or a search query 217 as shovm 
in Figure 2. The client computer 219 passes a behavior packet including the observed 
behavior in the client API. The RTAS module 214 uses the information contained in 
the user behavior packet to generate a behavior vector for the user action. 

Figure U is a block diagram illustrating the inputs and outputs of the process for 
transforming a page request into an content vector which is performed by the RTAS 
module 214 shov^ in Figure 2. If the observed user behavior includes a page, 
navigation or hierarchy request 21 8, a page content vector lookup module 1402 w^iich is 
pan of the RTAS module 214 retrieves the entity vector associated with the ID of the 
requested page from the static content vector database 234. The RTAS module 214 
augments the entity vector module of the user requested page with the user ID to 
provide a behavior vector. 

Figure 12 is a block diagram illustrating the inputs and outputs of the process for 
transforming a query into a content vector which is performed by the real-time ad server 
module showoi in Figure 2. If a client computer 219 observes user behavior such as a 
user query 217, the RTAS module 214 transforms the query 217 into a content vector by 
using the memory image of the high speed file 232 to provide an entity vector based 
upon the query terms. A preprocessing module 1502 which is part of the RTAS module 
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214, removes common words that are identified in the stop list file 204, combines the 
words that are part of a phrase list file 206 and performs the stemming process for all of 
the terms in the user query 217. The RTAS module 214 then creates a user behavior 
vector by augmenting the result of the aforementioned query 217 with the user ID by a 
form entity content vector module 1504, 
4. Selection of best entity to present. 

Figure 1 3 is a block diagram illustrating the functions of the ad selection process 
performed by the RTAS module 214 shown in Figure 2. If the client computer 219 
(shown in Figure 2) does not observe user behavior, the RTAS module 214 uses 
historical user profile vector from the profile vector database 226 as the basis for 
selection of the best entity to present. If the client computer 219 observes interactive 
behavior, the RTAS module 214 uses the observed user behavior vector as die basis for 
selecting the best entity to present. 

The RTAS module 214 uses the historical user profile vector or behavior vector 
as the basis of a vector comparison against all active ads as specified by the session 
control file 215. The contents of the session control files 215, which are loaded into 
memory by the RTAS module 214 during initialization, arc available for high speed 
searches. By placing the session control files in memory of the RTAS module 214, a 
performance gain is realized. 

Referring again to Figure 13, the RTAS module 214 perforais the optimvim 
entity selection by performing dot products of entity vectors with behavior and user 
vectors (state 1600). The RTAS module 214 performs a search process by computing a 
vector closeness metric between the vector to be compared and all active ad vectors. 
Although the RTAS module 214 may use any vector proximity metric, the preferred 
embodiment of the invention uses a vector inner product. 

At a state 1602, the RTAS module 214 selects the closest ad subject to inventory 
management constraints, Specifically, if the closest ad has already been presented 
sufficient times to the user population, the RTAS module 214 presents the second 
closest matching ad is selected. The inventory management scheme can be arbitrarily 
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complex and the RTAS module 214 has provisions to interface to an external inventory 
management module, that may be used to adaptively balance ad presentations subject to 
a series of external constraints. An inventory weighting module which is a 
sub-component of the RTAS module 214 performs all of the inventory control 
operations by adjusting the vector closeness weights. The RTAS module 214 then 
mesisures and ranks each ad ID by score (state 1604). 

Once the closest entity or ad has been selected, subject to the constraints 
described above, the RTAS module 214 passes the ID of the selected ad via the API to 
the client computer 219. The ED is used by the client computer 219 to retrieve and 
display the actual ad image to the user via the web. 

To improve performance, the RTAS module 214 caches the set of entity vectors 
and parameters described by the active session control file 215. The RTAS module 214 
obtains periodic updates from the EVUS module 228 for changed entities. 

5. Observe user response to entity presentation. 

Once the best entity or ad is determined and the host system generates a web 
page that incorporates the selected ad, the user response to the ad is monitored. If the 
user requests more information on the product, as indicated by clicking on the entity or 
ad, this event is sent via the API to the RTAS module 214. However, all ad 
presentations need not result in a message to the RTAS 214 module. 

6. Update of user behavior vector. 

The RTAS module 214 adapts the user behavior profile vector to reflect 
observed user actions. The observed user behavior vector is then used to update the 
profile vector for that user. The RTAS module 214 sends the user ID and observed user 
behavior vector to the PVUS module 224 for modification of the historical user profile 
vector. The operation of the PVUS module 224 is described below in greater detail. 

7. Update of ad or entity vector. 

If the user responds to the entity (ad, coupon or solicitation), the entity vector 
and user ID are sent to the EVUS module 228 for update (shown in Figure 17). The . 
EVUS module 228 then adapts the entity vector toward the observed behavior vector of 
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the user. The operation of the EVUS module 228 is described below in greater detail. 

Profile Vector Update Server Module 

The PVUS module 224 is responsible for the storage, retrieval and updating of 
the user profile vectors that are contained in the profile vector database 224. 

These user profile vectors are the basis for a wide range of processing 
capabilities including: 

(i) dissemination of targeted advertising, coupons, offers and information to 
the user; 

(ii) analysis of user behavior, 

(iii) correlation of user behavior with advertising, product and service 
descriptions; 

(iv) inference of user characteristics based on cross-correlation of user 
behavior profiles with demographic purchasing databases; 

(v) tracking user behavior over time; 

(vi) predictive modeling of likely user behavior and optimization of 
information presentation based on these predictive models; and 

(vii) accumulation of effectiveness and click-through statistics to optimize 
predictive models^ provide management reports and lay groundwork for 
increased ad revenues. 

In the preferred embodiment of the invention, the PVUS module 224 also 
incorporates external information, such as credit card purchasing histories into the user 
profiles. This information is easily incorporated, since the content vector representation 
accommodates the aggregation of heterogeneous symbolic information, such as web 
behavior and credit card purchases, into a unified high dimensional space. 

The PVUS module 224 is implemented as one or more executable computer 
programs that receive requests from clients over a network protocol such as TCP/IP and 
generates responses to such requests. The PVUS module 224 has one or more physical 
databases which are used to store the user profile content vectors and parameters which 
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are indexed by unique user IDs. Multiple PVUS modules may be in simultaneous 
operation to handle large numbers of users. When multiple servers are used, they are 
addressed by the clients as a single entity. The PVUS modules may be scaled across 
multiple hardware platforms to support a large user popiolation. This distribution is 
accomplished by multiplexing the user ID to select one of N physical servers. Each 
server may further multiplex the request to one of M physical databases. Multiplexing 
is achieved by generating a hash code from the user ID which results in essentially 
random bit distributions in the hash code. There are many multiplexing hashing 
algorithms, that may be used. However, the prefened embodiment uses the MD5 
algorithm. The multiplexor then uses a modulo N on the hash code to determine which 
of N children should handle the request. 

The PVUS module 224 performs the processing actions listed below. 
1 . Creation of new user profile vectors. 

Each user in the system is assigned a unique user ID. In the web environment 
this could be the user's Internet IP address or a host selected ID placed in the browser 
"cookie" file. If a request is made for a user ID that is not contained in the profile 
vector database 226, the PVUS module 224 creates an entry for the new user and 
initializes the new user profile vector to a pseudorandom content vector which will be 
later adjusted by the adaptation algorithm (shown in Figures 19a and 19b). 

2. Retrieval of user profile vectors and parameters. 

The PVUS module 224 obtains a user profile vector by using the unique user ID 
to determine a hash code. The entry in the hash table at that location contains a pointer 
to the information in the profile vector database 226. The PVUS module 224 uses the 
database pointer to perform the retrieval of the user profile vector. If the request for the 
profile vector is from the RTAS module 214, the PVUS module 226 passes the profile 
vector to the RTAS module 214 for subsequent use. 

3. Adaptation of user profile vectors. 

The PVUS module 224 performs the adaptation of the user profile vectors based, 
upon some observation about a user's behavior. As the user traverses a web site 
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utilizing the present invention, behaviors are observed including user requested queries, 
web pages and ads. Each observed behavior is converted into a content vector and is 
also used to adapt a user's profile vector which is stored in the profile vector database 
226. 

Figure 14 is a block diagram illustrating the profile vector adaptation process of 
the PVUS module 224 shown in Figure 2. The PVUS module 224 contains several sub- 
components including a transform query to content vector (TQCV) module 1700, a 
transform action to content vector (TACV) module 1704, a profde vector loolcup (PVL) 
module 1706, and a profile vector adaptation (PVA) module 1702. If the user enters a 
query 217 to the system, the query string and the user ID are passed to a TQCV module 
1700. The TQCV module 1700 transforms the query siring into a query content vector 
in the same manner as the process shown in Figure 10b. The resulting query content 
vector is passed to the PVA module 1702 for adaptation of the user profile vector. The 
PVA module 1702 utilizes the adaptation algorithm described below and shown in 
Figures 1 9a and 1 9b. A profile vector database update module 1704 writes the updated 
profile vector is to the profile vector database 226 for later use. 

If the user clicks on an ad or purchases a product 222, the TACV module 1704 
uses the ad or product description to adapt the user profile vector. This module 1704 
transforms the entity ID into a content vector via a table lookup in memory within the 
PVUS module 224. In parallel, the user ID is used to lookup the user profile vector 
from the profile vector database 226. The PVA module 1702 inputs these two vectors 
into the adaptation algorithm described in Figures 19a and 19b. The profile vector 
database update module 1704 then writes updated profile vector to the profile vector 
database 226 for later use. 
4. Demographic predictions and tagging. 

For many advertising and sales applications, it is advantageous to have an 
estimate of the demographic parameters for individuals as well as the entire user 
population. In the present system, although no user registration is performed, 
advertisers can analyze the profiles vectors to retrieve user demographics. Advertisers 
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can use these profile vectors to estimate the age, gender, household income (HHI), and 
other demographic parameters of a user. The present system has provisions to 
incorporate demogrs^hic models into its operation. When using these demographic 
models, the demographic parameters of the entire population of users are estimated and 
used to augment the information in the profile vector database 226. This estimate 
process can be performed by both conventional statistical methods or via neural network 
techniques. 

Figure 15 is a block diagram illustrating the inputs and the outputs of the model 
building process performed by the relationship, discovery and analysis module shown in 
Figure 2. Predictive models for the estimation of age, gender and HHI are constructed 
using a combination of previous observed behavior contained in a historical user actions 
database 226, ground truth information from user registration on a dififerent service or 
via a ground truth user demographics database 1904, and profile vectors from the profile 
vector database 226. Using this information, a modeling module 1900 constructs a set 
of model parameters. These model parameters are stored in a model parameter database 
1906. Any statistically valid process can be used in the modeling module 1900, 
including neiural network techniques, to derive the predictive model parameters. The 
typical outputs of the predictive model are age, gender and HHI. 

Figure 16 is a block diagram illustrating the process by which the PVUS module 

224 updates the profile vector database 226 with demographic information. For each 

user in the profile vector database, the PVL module 1706 retrieves the user's associated 

profile vector from the profile vector database 226. The PVL module 1 706 passes this 

information, with the user ID and historical actions to a predictive model processing 
module 2000. The predictive model processing module 2000 uses the model parameters 

from a model parameter database 190.6 in conjunction with the current user profile 

vector and previous observed behavior to form an estimate of a set of demographic 

parameters for the current user. This estimate is added to the information contained in 

the profile vector database 226 by a profile vector update module 1704. The augmented 

contents are used as input to the RTAS module 214 during ad selection and as part of 





(70) 



#F?| 2000-20555 ' 



P - 6 1 6 8 F 



- 36 - 



the relationship discovery and analysis process. 

Entity Vector Update Server Module 

The EVUS module 228 is responsible for the storage, retrieval and updating of 
the entity profile vectors &om the entity vector database 230. The EVUS module 228 is 
the main processing module in the system to read and to write the entity vector database 
230. 

The EVUS module 228 consists of one or more executable computer programs 
that receive requests from clients over a network protocol (TCP/IP) and generates 
responses to such requests. The EVUS module 228 may have one or more physical 
databases which are used to efficiently store and index the user profile content vectors 
and parameters by unique entity IDs. 

During normal operation, the EVUS module 228 performs the following 
processing. 

1 . Entity insertion and deletion. 

The EVUS module 228 inserts new entities or ads and removes old entities or 
ads from the entity vector database 230 in response to conmiands from the session 
compiler mod\ilc 210. When a new session is compiled, the session compiler module 
210 sends update commands, new entity vectors and parameters to the EVUS module 
228. Additionally, the session compiler module 210 sends commands to the EVUS 
module 228 to delete inactive entities from the entity vector database 230. 

2. Store and retrieve entity vectors and parameters. 

The EVUS module 228 stores and retrieves the cvirrent parameters and vectors 
for all the active entities in the system and retrieves the entity vector and associated 
parameters for a given entity ID. During the initialization of the RTAS module 214, the 
RTAS module 214 sends a command to the EVUS module 228 requesting a copy of the 
most recent entity vectors and parameters to hold in the memory of the RTAS module 
214. 

3 . Entity profile vector adaptation. 
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Figure 17 is a block diagram illustrating the entity vector adaptation process of 
the EVUS module 228 shown in Figure 2. The EVUS module 228 performs the entity 
vector adaptation in response to a message indicating that a user has responded to 
(clicked on) an entity. The EVUS module 228 includes various sub-components 
including an entity vector adaptation module 2100, a transform query to content vector 
(TQCV) module 2102, an entity vector lookup module 2104, a profile vector lookup 
module 2106 and an entity vector database update module 2108. 

An adaptation event occurs when a user enters a query 217 or clicks on an ad or 
performs an on-line purchase of a product 222. When the entity adaptation event 
occurs, the user action that resulted in the event, such as a user query 217, the EVUS 
module 228 obtains from the RTAS module 214 the entity ID for the selected ad and the 
user ID- 

If the user requests a query 217, the TQCV module 2102 transforms the actions 
into a query content vector, and passes the result to the entity vector adaptatioii module 
2100. If the user event was a clickthrough or purchase 222, the entity vector lookup 
module 2104 retrieves the entity vector for the selected entity from the entity vector 
database 230. The entity vector lookup module 2104 passes the vector for the selected 
entity to the entity vector adaptation module 2100. If the user ID was passed into the 
EVUS module 228, the profile vector lookup module 2106 retrieves the profile vector 
for the user from the profile vector database 226. The resulting content vector is then 
passed to the entity vector adaptation module 21 00. 

After receiving the inputs from the TQCV module 2 1 02, the entity vector lookup 
module 2104, and the profile vector lookup module 2106, the entity vector adaptation 
module 2100 performs the equations shown in Figures 19A and 19B. The entity vector 
adaptation module 2100 then passes the updated entity vector along with the entity ID 
and time stamp to the entity vector database update module 2108 where the information 
is stored in the entity vector database 230. 
4. Time updates. 

The EVUS module 228 generates a list of entity IDs whose vectors or 
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parameters that have changed since a given moment in time. This information is used to 
refresh the memory image of the EVUS module 228 that is maintained by the RTAS 
module 214. When the refresh command coniaining a time stamp of the last update is 
sent from RTAS module 214, the EVUS module 228 sends to the RTAS module 214 
the entity IDs, vectors parameters for those items that have changed and a new time 
stamp. This information is then saved in the RTAS internal memory for use in the 
entity selection process. 
5. Inventory management 

The EVUS module 228 performs inventory management weighting across all the 
ads in the system. The EVUS module 228 uses a weight parameter to adjust each of the 
ad selection scores. The weight parameter is determined by the ads targeted number of 
impressions and the time remaining for each ad. 



Profile and Entity Adaptation Algorithms 

Figure 18 is a flowchart Qlustrating the vector adaptation process of the profile 
-vector update server and the entity vector udpdate server upon the receipt of a user 
query 217 (shown in Figure 2). Both the PVUS module 224 and the EVUS module 228 
apply a set of adaptation algorithms to allow the evolution of profile vectors and entity 
vectors as a result of user interaction with the system. 

Starting at a state 2250, the PVUS module 224 updates the profile vector based 
upon the current user query 217. Moving to a decision state 2252, the profile vector of 
the user and the behavior vector for the search query is compared to the entity vectors 
and ranked according to this comparison to establish a score. The profile score of the 
user is compared against the behavior score for the search query to determine which 
score is larger. If the query score is larger, the PVUS module 224 proceeds to update 
the bias vectors (state 2254). The bias vectors arc used to make sure that during the 
continual mutual adaptation process that the vectors do not all end up with the same 
entity vector. Next, at a state 2258 an advertisement is selected based upon the query 
score. 
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Proceeding to a decision state 2260, the system checks whether a user clicked on 
the provided advertisement. If the user did not select the advertisement the system 
returns to the state 2250 to repeat the adaptation process upon future user queries. If the 
user selected an advertisement, the EVUS module 228 updates the selected ad vector 
with the behavior vector for the user query 217 (state 2262). Next, at a state 2264, the 
PVUS module 224 updates the profile vector with the entity vector for the 
advertisement and moves to a state 2274. 

Referring again to the decision state 2252, if the profile score is greater than the 
query score, the bias vectors are updated in state 2265. Next, at a state 2266, the ad 
selected by the profile scoring is sent to the client 219, Proceeding to a decision state 
2268, the system checks whether a user clicked on the provided advertisement. If the 
user did not select the advertisement, the system returns to the state 2250 to repeat the 
adaptation process upon the receipt of jfuture user queries 217. If the user selected an 
advertisement, the PVUS module 224 updates the profile vector with the entity vector 
for the advertisement (state 2270). The EVUS module 228 then updates the selected ad 
vector with the profile vector for the user query 217. 

Moving firom a state 2264 or a state 2272, at a state 2274 the cost model 
associated with the selected advertisement is updated. The system then returns to the 
state 2250 to repeat the adaptation process upon the receipt of fiaturc user queries 217. 

The profiles of individual users and the corresponding current query axe 
represented by the following two sets shown in equations 1 1 and 12. 

Ku={pr' pr'} (11) 

a^={?r\ -.^r'} (12) 

User queries includes topical information which may be represented by more 
than one content vector. Equation 1 3 shows that each ad is represented in a similar way 
to the profile vectors. 

^^>,^{^l"""..:A^'y (13) 

Equations 14 and 15 are applied during the decision state 2252 shown in Figure 
1 5 when computing the scores. 
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g_score(Q,,„A„...,A^) = • Va/we^^ x l(g, • a<'"*''> > threshold ^^^)] (15) 

The Fa/we parameter is computed by traditional cost model algorithms (not 
shown). 

Figures 19a and 19b are the equation flow diagrams for the fixed rate learning 
algorithm performed by the profile vectors update module and the entity vector update 
module shown in Figure 2. Unless otherwise noted, the adaptation equations shown in 
Figures 19a and 1 9b are common to both profile and entity content vector updates. The 
parameters used to control the adaptation process are shown in Figure 20. 

The following is a description of when the equations illustrated in Figures 19a 
and 19b are performed in relation to the states illustrated in Figure 18. The equations in 
a block 2276, 2284 (shown in Figure 19a) are performed during the state 2250 (shown 
in Figure 18) during the process of updating the profile vector with a query. The 
equations in a block 2278 are performed at the state 2262 during the process of updating 
the ad vector with a user query after the user selected an advertisement. Similarly, the 
equations in block 2280 are performed at the state 2264 during the update of the profile 
vector with the selected advertisement. 

The equations in block 2282 (shown in Figure 19a) are performed at the state 
2254 (shown in Figure 18) to update the bias vectors to insure that all of the vectors do 
not end up with the same multidimensional vector. The equations in a block 2286 are 
performed at the state 2272 during the update an ad vector with the profile vector. 
These equations are performed when the profile score of the user is greater than the 
query score. Similarly, the equations in a block 2288 (shown in Figure 19b) are 
performed in the state 2270 (shown in Figure 18) during the update of the profile vector 
with the ad vector. 

The equations in a block 2290 (shown in Figure 19b) are performed during the 
update of the bias vectors after the profile score of the user is greater than the score for 
the users query at the state 2265 (shown in Figure 18). 
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Calculation of Entity Inventory Weighting fCost Model') 



The RTAS module 214 keeps track of the number of impressions generated for 

each entity or ad and periodically sends a message to the EVUS module 228 containing 
each ad ID and the number of impressions generated for each ad. The RTAS module 

214 uses the ad parameters specifying the targeted number of impressions and the time 

each ad will remain eligible for serving to calculate inventory management weights. 

The weights are applied by the RTAS module 214 when scoring the active ads. The 

RTAS module 214 causes under-impressed ads to receive more impressions while 

suppressing impressions for over- impressed ads. 

Relationship Discovery and Analysis Processing Module 

The present system has the ability to perform relationship discovery and analysis 
on the contents of the profile vector database 226 and the entity vector database 230 
(shown in Figixre 2). The results of the analysis process are listed in a series of reports 
that are presented to an analyst 240. These reports provide high value actionable 
information about the behavior pattern of the system users. 

TTie RDA module 236 takes the contents of the profile vector database 226 and 
the entity vector database 230 to produce the analysis reports 238 (shown in Figure 2)» 
A variety of conventional statistical techniques or neiual network approaches are 
utilized to perform this analysis. 

The RDA module 266 performs three analytical fianctions including 
unsupervised categorization, supervised categorization and conventioneil statistics. Each 
of these functions is described below. 

1 , Unsupervised categorization. 

The RDA module 236 performs unsupervised categorization or clustering of the 
contents of the profile vector database 225, the entity vector database 230 or both of 
these modules. The RDA module 236 may use any clustering algorithm as long as the 
algorithm can process real number vectors. The result of the clustering is a set of cluster 
centroid vectors that represent regions of high density. These centroids are the. same 
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type of vectors that are used for all the other processing operations. Thus, the RDA 
system is able to find a set of word vectors that are closest in the content vector space to 
the centroid vector. The words associated with these vectors, and their closeness 
metrics, constitute the key concepts of the centroid. The evolution of cluster centroids 
over time provides trend information. The identification of word vectors close to these 
cluster centroids provides a key word summary for each cluster, easing the analysis and 
interpretation task. Conventional statistical analysis may also be used to investigate 
cluster contents. The variance of cluster membership is a reliable indication of cluster 
coherence and "unity of focus" in terms of behavior. The cluster identified in the 
product vector database 226 provides highly valuable information about the 
characteristics of the users who purchase the products. This result is a natural 
consequence of the mutual adaptation between the ad vectors and the user content 
vectors. The nxxmber of clusters found and the explanation of the clusters are listed in 
the analysis reports 238 for inspection by the analyst 240. 

2. Supervised categorization. 

The RDA module 236 also performs supervised categorization of the contents of 
the profile vector database 226, the entity vector database 230, or both of these modules. 
For supervised categorization, the RDA module 236 may employ any algorithm that can 
process real number vectors. The result of the categorization is a set of users and/or 
entities that are members of each category. The count and membership list, by category, 
are listed in the analysis reports 238 for inspection by the analyst 240. 

3. Conventional statistics. 

The RDA module 236 applies conventional statistics to the contents of the 
profile vector database 226, the entity vector database 230, or both of these modules. 
This analysis produces counts, count distributions, means and variances of the database 
contents as a whole or any subset which is selected by the analyst 240. The results of 
the processing axe listed in the analysis reports 238 for inspection by the analyst 240. 



A summary of the operation of the system for the advertising scenario is as 
follows. 
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System Initialization 

First, the word content vector learning module 200 creates multiple content 
vectors from te>ct input. This technique, results in a set of word content vectors, one 
word content vector for each v^ord found in the training vocabulary and not in the stop 
list 204. In the advertising scenario, the training texts are usually product descriptions 
and trade magazines. For instance, if the targeted domain of operation is sporting 
goods, the training corpus v^ould contain the product descriptions from sporting goods 
catalogs, the contents of several years of "Field and Stream" magazine and books on 
outdoor life. The selection of the correct training corpus, oriented toward the domain of 
operation, such as outdoor sports, gives the correct "spin" on the usage of words. In the 
aforementioned example,, "bow" becomes associated with "arrow" as opposed to 
"violin" or an action performed on stage at the completion of a performance. 

Next, the session compiler module 210 computes an initial set of entity vectors 
from descriptions of the products for sale. These descriptions might come from the 
product catalog or be typed in by a human operator. For instance, "Warm Goretex, 
down filled parka perfect for those cold winter nights and days on the ski slopes" might 
serve as the text initialization for the entity vector for a coat. The entity vector is a 
normalized weighted sxim of the word vectors of the words in the description. The 
session compiler module 210 creates an initial entity vector for each ad in the system. 

The session description file 212 describes the guidelines for ad placement, such 
as display times authorized, sites, which ads to show and how many impressions are 
available, is compiled into a machine usable form. This results in the creation of a 
session control file 215 with information that controls the operation of the ad serving 
process. Finally, a plurality of user profile vectors are initialized to NULL. 

Regular System Operation 

During normal operation, an Internet user visits the web site and the user's 
identity is established via login, or through the web browser cookie. Each user identity 
is associated with a profile vector. If the xiser is new, a null profile vector is created and 
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added to the profile vector database. If the user is known to the system, the user's 

profile vector is retrieved from the profile vector database. 

The system then observes the user's behavior. If a user performs a search query 

217, the user profile vector is updated using the content vector of the current query. If 

the user requests a v/eb page to read 218, the user profile vector is modified by the 

content vector of the requested web page. 

The updated profile vector is then used as the basis for selecting relevant ads to 
display to the user. Relevance is determined by closeness of the user profile vector to 
entity vectors stored in the ad vector database. The closest entity vector is selected as 
being most relevant. 

If the user is presented an ad, and the user requests more information of the 
subject of the ad by clicking on the ad, both the current ad entity vector and the profile 
vector are updated. The user profile vector is moved or adapted a small step in the . 
direction of the entity vector. The entity vector is moved or adapted a small step in the 
direction of the profile vector of the person who clicked on the ad. Thus, the system 
allows ads to assume the characteristics of the users that purchase them in a real-time 
adaptive maimer. 

Discovery and Analysis Mode 

During discovery and analysis mode, at periodic intervals, the system 
administrator performs relationship discovery and analysis of the contents of both the 
entity vector database 230 and the user profile vector database 226 to discover useful 
and exploitable characteristics of user behavior. The RDA module 236 performs vector 
clustering, reporting and provides sununary statistical information of system 
effectiveness in terms of user clickthrough rate. The behavior clusters discovered 
during analysis serves as the basis of advertising campaigns and provides valuable 
insight into user behavioral preferences. The behavior clusters can. be utilized as the 
initial conditions for entity vectors the advertiser wants to target by group, rather than 
on an individual basis. 
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The system shown in Figure 2 has two sets of adaptive components. First are 
the user profile vectors. Second are the content vectors for each of the advertisements. 
Both sets of vectors influence each other based upon the actions of the users. Ads are 
updated in such a manner as to adapt toward regions of high user interest, thus 
improving system effectiveness and automatically discovering group preferences. User 
profile vectors adapt based on the observed actions of the user, thus providing an 
accurate and timely representation of user preferences both individually and as a group. 

Since the sets of vectors are dependent on a user's actions and evolve with time, 
they encode a wealth of infonnation about the behavior of the user population. These 
content vector sets can be "mined" with the analysis tools to provide valuable actionable 
insight concerning both individual, group and whole population behavior. 

While the above detailed description has shown, described, and pointed out the 
fundamental novel features of the invention as applied to various embodiments, it will 
be understood that various omissions and substitutions and changes in the form and 
details of the system illustrated by those skilled in the art, without departing from the 
intent of the invention. 

4 Brief Description of Drawings 

Figure 1 is a functional block diagram illustrating a computer environment that 
may be associated with the present invention. 

Figure 2 is a functional block diagram illustrating the processing and data 
components of the present invention. 

Figure 3 is a block diagram illustrating the inputs and outputs of the pre- 
processing process of the word content vector learning module shown in Figure 2. 

Figure 4 is a block diagram illustrating the inputs and outputs of the hash table 
creation process of the word content vector learning module shown in Figure 2. 

Figure 5 is a block diagram illustrating the functions of the stem generating 
process of the word content vector learning module shown in Figure 2. 

Figure 6 is a block diagram illustrating the stem frequency statistics calculation 
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process of the word content vector learning module shown in Figure 2. 

Figure 7 is a diagram illustrating the different learning convolutional windows 
of the word content vector learning module shown in Figure 2. 

Figure 8 is a diagram illustrating the vector manipuiation process for adapting a 
stem vector by the vector of neighboring stems for a convolutional window shown in 
Figure 7. 

Figure 9 is a block diagram illustrating the inputs and outputs of the entity 
vector creation process of the session compiler shown in Figure 2. 

Figure 10a is a block diagram illustrating the inputs and outputs of the process 
for creating the high speed files shown in Figure 2. 

Figure 10b is a block diagram illustrating the inputs and outputs of the process 
for generating the session control file shown in Figure 2. 

Figure 11 is a block diagram illustrating the inputs and outputs of the process for 
transforming a page request into an content vector which is performed by the real time 
ad sever module shown in Figure 2. 

Figure 12 is a block diagram illustrating the inputs and outputs of the process for 
transforming a query into a content vector which is performed by the real time ad server 
module shown in Figure 2. 

Figxure 13 is a block diagram illustrating the functions of the ad selection process 
performed by the real time ad server shown in Figure 2. 

Figure 14 is a block diagram illustrating the functions of the profile vector 
adaptation process of the profile vector update server shovra in Figure 2. 

Figure 15 is a block diagram illustrating the inputs and the outputs of the model 
building process performed by the relationship, discovery and analysis module shown in 



Figure 16 is a block diagram illustrating the functions of the process by which 



database with demographic information. 

Figure 17 is a block diagram illustrating the functions of the process by which 



Figtire 2, 



the profile vector update server module shown in Figure 2 updates the profile vector 



(81) #M2 000-20555 

P - 6 1 6 8 F -47 

the entity vector update server module shown in Figure 2 adapts entity vectors. 

Figure 18 is a flowchart illustrating the vector adaptation process of the profile 
vector update server and the entity vector udpdate server shown in Figure 2. 

Figures 19a and 19b are the equation flow diagrams for the fixed rate learning 
algorithm performed by the profile vectors update module and the entity vector update 
module shown in Figure 2. 

Figure 20 is a chart containing a summary of sample run time parameters for the 
fixed rate learning algorithm shown in Figures 19a and 1 9b. 
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L Abstract 

A system and method for selecting and presenting personally targeted entities 
such as advertising, coupons, products and information content, based on Tracking 
observed behavior on a user-by-user basis and utilizing an adaptive vector space 
representation for both information and behavior. The system matches users to entities 
in a manner that improves with increased operation and observation of user behavior. 
User behavior and entities (ads, coupons, products) and information (text) arc all 
represented as content vectors in a unified vector space. The system is based on an 
infomfatidn representation called content vectors that utilizes a constrained self 
organization learning technique to learn the relationships between symbols (typically 
words in unstructured text). Users and entities are each represented as content vectors. 



2 Representative Drawing Fig. 1 



